-- Logs begin at Wed 2022-07-27 07:07:40 UTC, end at Wed 2022-07-27 08:10:02 UTC. -- Jul 27 07:40:43.342091 dv-cinder-825492-32-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 07:40:43.350657 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 07:40:43.353093 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 07:40:43 2022] *** Jul 27 07:40:43.353093 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 07:40:43.353093 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 07:40:43.353093 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: nodename: dv-cinder-825492-32-iscsi Jul 27 07:40:43.353093 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: machine: x86_64 Jul 27 07:40:43.353093 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: clock source: unix Jul 27 07:40:43.353093 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: pcre jit disabled Jul 27 07:40:43.353093 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: detected number of CPU cores: 4 Jul 27 07:40:43.353093 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: current working directory: / Jul 27 07:40:43.353093 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: detected binary path: /usr/bin/uwsgi-core Jul 27 07:40:43.353093 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: your processes number limit is 47680 Jul 27 07:40:43.353714 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: your memory page size is 4096 bytes Jul 27 07:40:43.353714 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: detected max file descriptor number: 2048 Jul 27 07:40:43.353714 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: lock engine: pthread robust mutexes Jul 27 07:40:43.353714 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: thunder lock: enabled Jul 27 07:40:43.353714 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 07:40:43.353714 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 07:40:43.392048 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: Python main interpreter initialized at 0x563972e839c0 Jul 27 07:40:43.392048 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: python threads support enabled Jul 27 07:40:43.392048 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: your server socket listen backlog is limited to 100 connections Jul 27 07:40:43.392048 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: your mercy for graceful operations on workers is 90 seconds Jul 27 07:40:43.392508 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 07:40:43.392508 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: *** Operational MODE: preforking *** Jul 27 07:40:43.392702 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: *** uWSGI is running in multiple interpreter mode *** Jul 27 07:40:43.392702 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: spawned uWSGI master process (pid: 103264) Jul 27 07:40:43.392903 dv-cinder-825492-32-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 07:40:43.393594 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: spawned uWSGI worker 1 (pid: 103265, cores: 1) Jul 27 07:40:43.393779 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: spawned uWSGI worker 2 (pid: 103266, cores: 1) Jul 27 07:40:43.393930 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 07:40:44.061533 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 07:40:44.090912 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 07:40:45.130236 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 07:40:45.130236 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: from cryptography.utils import int_from_bytes Jul 27 07:40:45.130933 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 07:40:45.130933 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: from cryptography.utils import int_from_bytes Jul 27 07:40:45.144338 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 07:40:45.144338 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: from cryptography.utils import int_from_bytes Jul 27 07:40:45.144797 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 07:40:45.144797 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: from cryptography.utils import int_from_bytes Jul 27 07:40:47.656494 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 07:40:47.657066 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 07:40:47.657415 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 07:40:47.657501 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 07:40:47.657595 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 07:40:47.657690 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 07:40:47.657776 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 07:40:47.657875 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 07:40:47.657962 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 07:40:47.658052 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 07:40:47.658256 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.658420 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.658582 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.658749 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.658931 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.659103 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.659256 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.659426 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.659594 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.659760 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.659917 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.660074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.660243 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.660399 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.660570 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.660724 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.660902 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.661061 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.661163 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.661325 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.661506 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.661641 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.662057 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-32-iscsi {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.662162 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-32-iscsi {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.662387 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.662475 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.662700 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.662788 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.663051 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.663151 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.663367 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.663472 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.663673 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.663785 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.664002 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.664105 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.664310 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.664396 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.664811 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.664920 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.665253 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.665356 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.665561 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.665654 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.665877 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.665985 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.666313 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.666558 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.666747 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.666901 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.667080 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.667231 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.667411 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.667563 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.667726 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.667870 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.668054 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.668203 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.668367 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.668500 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.668769 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-32-iscsi {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.668899 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-32-iscsi {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.669091 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.669186 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.669409 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.669498 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.669726 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.669812 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.670145 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.670251 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.670461 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.670555 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.670773 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.670866 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.671125 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.671224 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.671462 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.671550 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.671773 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.671860 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.672102 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.672197 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.672424 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.672516 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.672746 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.672845 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.673068 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.673156 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.673406 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.673546 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.673680 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.673777 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.673989 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.674075 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.674311 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.674397 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.674616 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.674716 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.674942 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.675032 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.675198 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.675284 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.675509 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.675603 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.675879 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.675979 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.676157 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.676243 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.676482 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.676572 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.676735 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.676829 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.676987 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.677093 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.677308 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.677421 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.677656 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.677756 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.677968 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.678063 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.678277 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.678372 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.678587 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.678740 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.678922 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.679026 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.679220 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.679306 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.679528 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.679614 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.679838 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.679927 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.680144 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.680230 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.680465 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.680553 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.680783 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.680870 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.681106 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.681205 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.681416 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.681502 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.681743 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.681832 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.682140 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.682238 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.682392 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.682487 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.682703 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.682800 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.683070 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.683158 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.683394 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.683494 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.683749 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.683853 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.684024 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.684110 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.684346 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.684449 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.684658 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.684760 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.684962 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.685050 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.685269 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.685374 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.685593 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.685678 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.685930 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.686016 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.686236 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.686330 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.686488 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.686581 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.686794 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.686955 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.687125 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.687213 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.687446 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.687543 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.687754 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.687848 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.688062 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.688159 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.688367 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.688452 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.688667 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.688757 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.688975 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.689074 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.689280 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.689367 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.689588 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.689681 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.689893 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.689980 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.690201 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.690287 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.690504 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.690598 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.690812 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.690919 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.691144 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.691244 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.691452 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.691554 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.691773 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.691868 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.692094 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.692180 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.692402 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.692497 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.692708 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.692800 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.693540 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.693649 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.693850 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.693942 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.694170 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.694265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.694479 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.694565 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.694785 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.694921 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.695133 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.695221 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.695440 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.695526 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.695745 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.695844 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.696065 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.696151 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.696375 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.696462 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.696682 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.696776 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.697001 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.697094 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.697304 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.697389 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.697611 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.697713 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.697930 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.698016 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.698238 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.698331 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.698543 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.698633 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.698847 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.699000 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.699180 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.699277 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.699484 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.699572 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.699789 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.699876 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.700091 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.700178 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.700398 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.700486 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.700699 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.700799 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.701019 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.701105 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.701344 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.701431 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.701658 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.701746 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.701969 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.702056 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.702279 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.702374 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.702603 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.702692 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:40:47.702965 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.703073 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.703302 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.703389 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.703647 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.703738 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.703960 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.704069 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.704294 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.704382 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.704625 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.704711 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.704946 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.705034 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.705258 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.705343 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.705571 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.705657 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.705898 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.705986 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.706210 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.706296 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.706521 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.706607 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.706832 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.706950 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.707175 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.707262 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.707497 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.707605 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.707829 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.707916 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.708146 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.708238 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.708464 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.708551 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.709365 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.709464 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.709684 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.709780 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.710006 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.710169 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.710337 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.710424 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.710660 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.710748 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.710996 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.711088 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.711342 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.711430 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.711687 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.711774 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.712003 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.712099 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.712329 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.712415 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.712654 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.712739 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.712965 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.713061 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.713278 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.713364 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.713589 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.713684 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.713915 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.714014 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.714245 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.714332 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.714558 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.714643 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.714891 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.714993 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.715219 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.715315 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.715533 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.715618 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.715843 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.715930 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.716158 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.716244 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.716470 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.716557 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.716810 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.716897 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.717127 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.717213 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.717444 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.717530 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.717756 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.717843 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.718075 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.718161 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.718388 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.718474 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.718700 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.718794 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.719034 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.719135 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.719341 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.719428 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.719648 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.720000 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.720219 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.720307 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.720532 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.720627 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.720836 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.720921 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.721155 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.721248 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.721484 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.721583 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.721790 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.721877 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.722122 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.722216 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.722426 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.722519 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.722735 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.722830 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.723071 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.723161 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.723383 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.723480 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.723687 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.723774 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.723997 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.724082 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.724336 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.724446 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.724644 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.724731 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.724969 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.725055 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.725282 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.725368 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.725590 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.725676 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.725915 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.726000 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.726220 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.726307 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.726525 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.726610 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.726842 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.726979 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.727179 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.727280 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.727491 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.727577 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.727808 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.727904 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.728121 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.728209 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.728448 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.728542 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.728763 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.728858 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.729078 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.729171 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.729415 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.729501 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.729749 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.729880 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.730086 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.730198 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.730392 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.730497 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.730718 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.730814 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.731060 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.731157 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.731369 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.731465 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.731683 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.731786 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.731991 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.732078 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.732301 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.732398 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.732605 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.732700 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.732915 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.733011 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.733222 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.733310 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.733528 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.733615 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.733834 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.733920 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.734138 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.734233 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.734444 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.734537 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.734774 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.734870 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.735113 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.735220 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.735425 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.735537 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.735722 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.735826 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.736026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.736126 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.736372 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.736460 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.736682 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.736770 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.737025 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.737125 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.737362 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.737452 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.737681 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.737767 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.738006 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.738102 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.738322 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.738409 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.738639 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.738726 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.738973 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.739065 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.739290 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.739376 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.739603 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.739700 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.739945 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.740037 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.740267 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.740352 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.740581 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.740674 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.740903 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.740997 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.741218 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.741304 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.741548 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.741635 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.741861 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.741957 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.742181 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.742267 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.742489 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.742585 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.742807 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.742917 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.743178 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.743276 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.743518 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.743614 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.743838 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.743931 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.744165 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.744308 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.744482 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.744583 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.744804 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.744938 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.745112 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.745208 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.745428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.745547 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.745752 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.745911 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.746041 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.746121 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.746372 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.746477 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.746686 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.746812 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.747032 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.747150 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.747345 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.747436 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.747675 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.747765 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.747988 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.748075 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.748313 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.748415 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.748618 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.748708 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.748934 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.749023 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.749266 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.749353 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.749604 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.749691 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.749919 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.750017 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.750231 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.750324 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.750551 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.750645 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.750864 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.750992 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.751198 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.751285 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.751511 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.751605 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.751815 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.751910 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.752123 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.752210 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.752434 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.752521 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.752750 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.752846 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.753062 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.753149 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.753373 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.753466 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.753675 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.753772 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.753991 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.754081 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.754299 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.754393 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.754604 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.754691 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.754931 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.755043 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.755249 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.755344 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.756101 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.756201 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.756416 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.756504 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.756743 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.756829 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.757068 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.757155 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.757377 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.757463 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.757684 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.757783 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.758009 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.758096 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.758321 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.758481 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.758627 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.758724 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.758952 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.759041 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.759260 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.759348 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.759606 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.759702 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.759919 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.760055 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.760226 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.760313 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.760543 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.760639 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.760864 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.760951 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.761175 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.761262 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.761494 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.761659 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.761805 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.761900 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.762116 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.762210 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.762438 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.762534 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.762752 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.762839 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.763159 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.763248 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.763473 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.763561 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.763786 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.763872 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.764097 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.764185 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.764410 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.764550 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.764733 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.764820 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.765043 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.765129 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.765354 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.765443 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.765665 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.765758 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.765966 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.766070 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.766277 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.766364 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.766594 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.766682 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.767200 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.767305 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.767535 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.767622 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.767856 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.767952 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.768176 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.768271 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.768494 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.768582 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.768818 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.768922 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.769146 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.769243 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.769475 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.769562 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.769817 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.769913 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.770130 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.770248 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.770444 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.770549 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.770750 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.770838 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.771084 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.771766 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.771944 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.772047 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.772254 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.772340 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.772561 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.772656 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.772868 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.772968 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.773177 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.773264 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.773523 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.773621 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.773783 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.773880 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.774091 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.774177 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.774394 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.774537 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.774710 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.774802 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.775040 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.775130 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.775355 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.775454 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.775660 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.775747 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.775984 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.776071 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.776295 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.776446 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.776598 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.776689 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.776904 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.776991 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.777210 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.777296 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.777554 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.777643 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.777861 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.777948 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.778200 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.778297 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.778529 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.778658 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.778875 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.779033 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.779208 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.779304 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.779516 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.779603 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.779844 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.779930 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.780154 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.780264 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.780455 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.780542 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.780761 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.780848 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.781073 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.781161 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.781382 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.781468 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.781685 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.781771 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.781996 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.782084 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.782305 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.782401 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.782616 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.782703 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.782946 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.783041 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.783253 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.783351 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.783565 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.783651 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.783871 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.783966 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.784186 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.784273 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.784498 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.784642 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.784802 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.784893 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.785105 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.785237 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.785418 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.785515 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.785727 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.785814 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.786028 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.786118 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.786341 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.786508 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.786645 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.786773 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.787011 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.787103 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.787319 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.787421 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.787627 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.787715 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.787931 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.788018 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.788241 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.788337 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.788550 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.788637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.788855 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.788948 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.789183 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.789271 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.789493 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.789629 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.789800 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.789886 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.790103 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.790191 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.790415 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.790505 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.790718 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.790805 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.791047 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.791138 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.791360 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.791464 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.791686 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.791785 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.792002 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.792089 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.792309 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.792394 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.792618 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.792714 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.792922 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.793016 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.793225 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.793318 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.793527 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.793622 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.793835 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.793922 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.794137 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.794223 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.794439 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.794539 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.794744 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.794943 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.795072 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.795171 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.795376 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.795467 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.795699 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.795785 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.796008 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.796101 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.796310 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.796398 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.796616 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.796702 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.796919 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.797005 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.797266 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.797361 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.797570 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.797656 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.797929 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.798015 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.798235 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.798322 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.798552 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.798639 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.798872 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.798996 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.799211 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.799306 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.799523 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.799609 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.799838 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.799938 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.800146 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.800232 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.800460 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.800545 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.800771 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.800871 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.801084 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.801178 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.801388 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.801475 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.801693 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.801796 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.802014 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.802101 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.802328 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.802444 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.802661 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.802757 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.803008 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.803101 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.803333 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.803421 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.803660 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.803749 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.803966 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.804054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.804278 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.804372 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.804591 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.804678 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.804900 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.804990 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.805210 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.805297 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.805522 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.805614 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.805832 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.805926 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.806144 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.806238 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.806457 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.806545 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.806767 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.806863 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.807103 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.807208 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.807413 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.807509 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.807723 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.807818 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.808034 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.808130 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.808337 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.808424 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.808663 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.808751 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.808975 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.809072 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.809282 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.809378 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.809591 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.809685 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.809894 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.809990 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.810205 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.810291 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.810507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.810593 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.810966 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.811058 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.811279 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.811367 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.811590 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.811677 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.811892 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.811980 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.812203 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.812291 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.812514 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.812602 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.812833 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.812921 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.813145 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.813231 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.813450 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.813536 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.813870 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.813958 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.814183 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.814269 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.814495 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.814590 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.814807 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.814954 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.815137 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.815228 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.815442 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.815613 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.815754 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.815841 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.816079 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.816173 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.816384 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.816480 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.816688 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.816787 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.816992 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.817079 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.817316 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.817411 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.817621 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.817715 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.817944 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.818574 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.818922 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.819016 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.819217 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.819377 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.819525 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.819602 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.819941 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.820037 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.820255 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.820342 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.820568 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.820696 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.820894 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.820985 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.821218 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.821295 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.821543 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.821629 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.821847 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.821960 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.822163 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.822248 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.822473 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.822561 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.822800 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.822914 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.823149 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.823245 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.823464 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.823560 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.823783 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.823878 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.824087 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.824175 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.824413 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.824501 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.824738 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.824838 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.825052 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.825178 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.825376 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.825463 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.825796 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.825892 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.826123 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.826218 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.826437 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.826525 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.826762 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.826984 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.827120 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.827217 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.827426 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.827514 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.827733 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.827821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.828045 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.828138 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.828351 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.828439 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.828657 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.828745 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.828983 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.829077 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.829288 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.829375 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.829600 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.829688 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.829910 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.830038 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.830223 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.830324 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.830605 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.830861 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.831066 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.831195 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.831281 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.831372 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.831454 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.831657 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.831748 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.831838 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.832063 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.832167 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.832402 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.832600 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.832713 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.832801 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.833406 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.833522 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.833522 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.833777 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.833777 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.833902 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.833981 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.834202 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.834296 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.834377 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.834576 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.834676 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.835011 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.835160 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.835281 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.835382 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.835563 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.835654 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.835897 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.835988 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.836226 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.836320 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.836539 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.836635 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.836875 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.836965 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.837208 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.837295 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.837526 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.837612 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.837847 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.837935 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.838175 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.838273 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.838479 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.838576 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.838786 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.838874 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.839123 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.839211 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.839428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.839528 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.839736 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.839826 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.840044 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.840131 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.840359 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.840461 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.840663 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.840758 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.840968 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.841054 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.841273 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.841374 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.841597 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.841688 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.841904 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.841993 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.842229 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.842324 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.842538 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.842626 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.842843 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.842961 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.843176 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.843266 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.843479 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.843574 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.843825 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.843952 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.844131 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.844220 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.844467 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.844564 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.845047 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.845178 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.845368 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.845456 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.845697 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.845881 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.846013 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.846112 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.846326 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.846420 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.846643 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.846732 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.846981 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.847088 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.847298 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.847391 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.847613 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.847700 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.847929 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.848026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.848246 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.848333 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.848560 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.848647 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.848869 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.848972 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.849187 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.849813 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.850034 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.850130 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.850351 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.850439 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.850943 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.851033 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.851280 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.851371 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.851600 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.851690 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.851915 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.852002 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.852229 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.852316 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.852547 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.852635 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.852863 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.852950 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.853178 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.853272 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.853493 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.853580 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.853806 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.853903 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.854120 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.854217 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.854451 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.854538 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.854775 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.854862 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.855131 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.855237 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.855474 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.855562 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.855795 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.855881 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.856113 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.856201 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.856429 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.856516 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.856745 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.856832 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.857105 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.857208 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.857423 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.857510 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.857730 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.857830 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.858046 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.858133 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.858361 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.858448 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.858676 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.858781 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.859017 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.859129 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.859333 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.859422 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.859650 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.859746 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.859970 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.860143 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.860285 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.860381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.860596 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.860684 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.860909 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.860995 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.861222 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.861309 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.861546 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.861633 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.861882 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.861969 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.862204 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.862290 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.862519 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.862606 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.862834 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.862983 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.863177 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.863274 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.863700 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.863794 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.864018 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.864104 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.864356 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.864452 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.864684 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.864772 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.865066 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.865161 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.865396 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.865542 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.865720 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.865823 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.866051 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.866181 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.866358 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.866455 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.866669 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.866763 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.867004 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.867095 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.867322 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.867411 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.867625 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.867724 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.867954 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.868041 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.868266 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.868355 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.868574 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.868661 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.868895 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.868988 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.869207 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.869294 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.869744 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.869833 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.870098 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.870186 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.870419 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.870504 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.870752 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.870839 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.871107 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.871209 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.871426 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.871515 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.871736 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.871824 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.872061 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.872156 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.872369 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.872456 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.872676 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.872763 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.872994 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.873089 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.873307 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.873393 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.873674 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.873773 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.873923 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.874020 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.874237 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.874331 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.874547 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.874634 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.874851 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.874972 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.875189 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.875277 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.875498 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.875609 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.875826 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.875933 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.876129 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.876216 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.876434 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.876521 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.876739 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.876828 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.877051 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.877152 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.877356 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.877443 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.877659 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.877754 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.877963 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.878050 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.878267 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.878363 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.878580 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.878667 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.878914 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.879017 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.879216 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.879315 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.879522 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.879610 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.879836 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.879924 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.880142 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.880238 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.880974 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.881077 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.881347 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.881446 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.881679 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.881778 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.881990 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.882078 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.882295 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.882382 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.882616 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.882705 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.882951 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.883046 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.883283 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.883371 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.883599 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.883688 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.883913 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.884001 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.884261 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.884391 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.884581 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.884669 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.885130 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.885222 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.885469 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.885561 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.885794 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.885885 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.886132 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.886220 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.886468 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.886554 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.886780 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.886858 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.887116 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.887194 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.887425 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.887587 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.887753 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.887831 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.888068 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.888144 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.888382 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.888468 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.888697 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.888773 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.889010 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.889086 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.889324 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.889401 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.889636 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.889770 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.889947 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.890024 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.890258 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.891074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.891173 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.891246 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.891312 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.891379 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.891379 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.891514 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.891581 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.891655 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.891792 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.891881 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.892106 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.892183 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.892450 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.892538 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.892773 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.892874 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.893094 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.893180 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.893411 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.893499 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.893730 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.893826 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.894042 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.894129 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.894353 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.894492 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.894662 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.894759 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.894993 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.895090 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.895313 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.895400 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.895647 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.895737 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.895962 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.896053 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.896588 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.896694 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.896927 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.897242 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.897569 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.897898 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.898218 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.898544 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.898875 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.899103 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.899256 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.899598 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.899713 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.899915 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.900249 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.900345 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.900599 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.900742 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.900934 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.901096 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.901276 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.901591 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.901760 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.901908 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.902053 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.902239 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.902492 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.902821 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.903165 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.903704 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.904023 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.904437 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.904749 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.905060 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.905165 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.905580 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.905967 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.906291 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.906599 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.906935 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.907254 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.907350 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.907624 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.907790 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.907992 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.908091 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.908365 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.908522 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.908696 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.908785 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.909006 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.909095 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.909317 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.909415 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.909625 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.909720 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.909932 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.910022 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.910241 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.910347 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.910578 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.910741 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.910924 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.911016 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.911243 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.911344 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.911562 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.911674 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.911872 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.912277 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.912372 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.912459 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.912541 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.912633 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.912776 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.912866 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.913085 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.913175 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.913398 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.913487 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.913704 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.913801 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.914013 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.914103 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.914318 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.914407 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.914626 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.914715 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.914957 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.915052 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.915265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.915356 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.915579 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.915677 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.915886 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.915982 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.916203 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.916324 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.916501 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.916601 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.916808 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.916897 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.917122 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.917252 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.917449 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.917549 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.917789 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.917898 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.918104 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.918194 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.918427 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.918540 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.918731 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.918819 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.919078 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.919211 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.919390 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.919481 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.919702 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.919791 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.920020 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.920108 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.920335 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.920425 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.920643 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.920740 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.920957 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.921048 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.921274 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.921365 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.921583 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.921675 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.921894 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.921991 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.922207 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.922295 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.922516 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.922612 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.922829 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.923020 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.923183 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.923272 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.923510 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.923606 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.923815 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.923913 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.924142 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.924242 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.924463 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.924552 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.924785 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.924874 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.925104 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.925203 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.925419 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.925506 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.925728 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.925817 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.926027 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 07:40:47.926125 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.926349 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.926661 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.927000 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.927318 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.928124 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.928436 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.928749 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.929067 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.929384 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.929718 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.930106 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.930385 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.930972 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.931088 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.931366 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.931684 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.932043 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.932365 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.932683 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.934513 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.934866 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:40:47.935152 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 07:40:48.079601 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO dbcounter [None req-9ac4667e-fcbe-4c17-b0cf-fcb51d61b554 None None] Registered counter for database nova_api Jul 27 07:40:48.088827 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO dbcounter [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] Registered counter for database nova_api Jul 27 07:40:48.101698 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG oslo_db.sqlalchemy.engines [None req-9ac4667e-fcbe-4c17-b0cf-fcb51d61b554 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 07:40:48.108671 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_db.sqlalchemy.engines [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 07:40:48.108988 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writer thread running {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 07:40:48.115539 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writer thread running {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 07:40:48.165759 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.context [None req-9ac4667e-fcbe-4c17-b0cf-fcb51d61b554 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b(cell1) {{(pid=103266) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 07:40:48.169766 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-9ac4667e-fcbe-4c17-b0cf-fcb51d61b554 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:40:48.170729 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.context [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b(cell1) {{(pid=103265) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 07:40:48.171357 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-9ac4667e-fcbe-4c17-b0cf-fcb51d61b554 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:40:48.172143 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-9ac4667e-fcbe-4c17-b0cf-fcb51d61b554 None None] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:40:48.174112 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-9ac4667e-fcbe-4c17-b0cf-fcb51d61b554 None None] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:40:48.174658 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:40:48.176172 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO dbcounter [None req-9ac4667e-fcbe-4c17-b0cf-fcb51d61b554 None None] Registered counter for database nova_cell0 Jul 27 07:40:48.176274 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:40:48.176992 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:40:48.179645 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:40:48.181638 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO dbcounter [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] Registered counter for database nova_cell0 Jul 27 07:40:48.182373 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO dbcounter [None req-9ac4667e-fcbe-4c17-b0cf-fcb51d61b554 None None] Registered counter for database nova_cell1 Jul 27 07:40:48.187064 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO dbcounter [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] Registered counter for database nova_cell1 Jul 27 07:40:48.191418 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG oslo_db.sqlalchemy.engines [None req-9ac4667e-fcbe-4c17-b0cf-fcb51d61b554 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 07:40:48.192188 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG oslo_db.sqlalchemy.engines [None req-9ac4667e-fcbe-4c17-b0cf-fcb51d61b554 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 07:40:48.194806 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_db.sqlalchemy.engines [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 07:40:48.198546 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_db.sqlalchemy.engines [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 07:40:48.199607 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writer thread running {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 07:40:48.201060 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writer thread running {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 07:40:48.202373 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writer thread running {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 07:40:48.343014 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writer thread running {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 07:40:48.349142 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO dbcounter [None req-9ac4667e-fcbe-4c17-b0cf-fcb51d61b554 None None] Registered counter for database nova_cell0 Jul 27 07:40:48.352516 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO dbcounter [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] Registered counter for database nova_cell0 Jul 27 07:40:48.359108 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG oslo_db.sqlalchemy.engines [None req-9ac4667e-fcbe-4c17-b0cf-fcb51d61b554 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 07:40:48.362099 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_db.sqlalchemy.engines [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 07:40:48.363697 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writer thread running {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 07:40:48.367047 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writer thread running {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 07:40:48.700691 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: WARNING keystonemiddleware.auth_token [None req-9ac4667e-fcbe-4c17-b0cf-fcb51d61b554 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 07:40:48.701958 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: WARNING keystonemiddleware.auth_token [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 07:40:48.707866 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: WARNING keystonemiddleware.auth_token [None req-9ac4667e-fcbe-4c17-b0cf-fcb51d61b554 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 07:40:48.709196 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: WARNING keystonemiddleware.auth_token [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 07:40:49.050655 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: WARNING keystonemiddleware.auth_token [None req-9ac4667e-fcbe-4c17-b0cf-fcb51d61b554 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 07:40:49.050935 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: WARNING keystonemiddleware.auth_token [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 07:40:49.056552 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: WARNING keystonemiddleware.auth_token [None req-9ac4667e-fcbe-4c17-b0cf-fcb51d61b554 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 07:40:49.056881 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: WARNING keystonemiddleware.auth_token [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 07:40:49.061791 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563972e839c0 pid: 103266 (default app) Jul 27 07:40:49.062107 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563972e839c0 pid: 103265 (default app) Jul 27 07:40:49.063896 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-9ac4667e-fcbe-4c17-b0cf-fcb51d61b554 None None] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:40:49.065045 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-9ac4667e-fcbe-4c17-b0cf-fcb51d61b554 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001710 Jul 27 07:40:49.065447 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Wed Jul 27 07:40:49 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:42:05.256578 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:05.257884 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002027 Jul 27 07:42:05.258453 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 27 07:42:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:42:05.270142 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_api:SELECT=3 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:05.271278 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_cell1:SELECT=3 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:05.272264 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_cell0:SELECT=3 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:05.273558 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:06.136742 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-856a4080-f066-4991-8917-01d695af427d admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:06.169404 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-856a4080-f066-4991-8917-01d695af427d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.904680 Jul 27 07:42:06.170351 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jul 27 07:42:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:42:08.378302 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:08.379350 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-90a00eef-620e-400b-9440-b601c41542b2 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 27 07:42:08.379738 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 2/4] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 27 07:42:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:42:08.879140 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-6960b6b9-842d-4915-b139-76d3e10c5fb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "ram": 256, "name": "cirros256", "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:08.899390 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:42:08.899390 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: warnings.warn(msg) Jul 27 07:42:08.927197 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-6960b6b9-842d-4915-b139-76d3e10c5fb7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.541236 Jul 27 07:42:08.927855 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 3/5] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 27 07:42:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 07:42:08.942443 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_api:SELECT=3 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:08.943755 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_cell0:SELECT=3 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:08.944978 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_cell1:SELECT=3 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:08.945929 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:09.151837 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-2ca5c07d-6b9d-4ec6-92a1-3ecaf3535d64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:09.156334 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:42:09.156334 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: warnings.warn(msg) Jul 27 07:42:09.221076 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-2ca5c07d-6b9d-4ec6-92a1-3ecaf3535d64 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284907 Jul 27 07:42:09.221673 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 3/6] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jul 27 07:42:08 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:42:11.480070 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-6960b6b9-842d-4915-b139-76d3e10c5fb7 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:11.481058 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-6960b6b9-842d-4915-b139-76d3e10c5fb7 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Jul 27 07:42:11.481658 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 4/7] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 27 07:42:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:42:12.258922 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-8753442b-b20d-482a-bc50-6da9b49e4c70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "disk": 5, "vcpus": 1, "name": "ds512M"}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:12.279143 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:42:12.279143 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: warnings.warn(msg) Jul 27 07:42:12.301284 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-8753442b-b20d-482a-bc50-6da9b49e4c70 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.812604 Jul 27 07:42:12.305958 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 4/8] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 27 07:42:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 07:42:12.314357 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-89b95f53-da08-4078-8858-96567df522d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:12.317506 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:42:12.317506 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: warnings.warn(msg) Jul 27 07:42:12.354431 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-89b95f53-da08-4078-8858-96567df522d5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043581 Jul 27 07:42:12.355868 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 5/9] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jul 27 07:42:12 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:42:14.582133 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-8753442b-b20d-482a-bc50-6da9b49e4c70 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:14.583176 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-8753442b-b20d-482a-bc50-6da9b49e4c70 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 27 07:42:14.583583 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 27 07:42:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:42:15.085140 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-314fe1f8-1d5c-4b51-a8c0-a987f1884852 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 1024, "name": "ds1G"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:15.105470 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-314fe1f8-1d5c-4b51-a8c0-a987f1884852 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.515762 Jul 27 07:42:15.106035 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 6/11] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 27 07:42:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 07:42:15.118144 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-d16d57d3-ed07-4889-bcdc-61286834e005 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:15.143930 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-d16d57d3-ed07-4889-bcdc-61286834e005 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029422 Jul 27 07:42:15.144433 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 6/12] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jul 27 07:42:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:42:17.431109 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-314fe1f8-1d5c-4b51-a8c0-a987f1884852 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:17.432113 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-314fe1f8-1d5c-4b51-a8c0-a987f1884852 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jul 27 07:42:17.432679 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 7/13] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 27 07:42:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:42:17.874535 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-37757cd4-3cb0-48f3-b9a9-6cc2bc5f4ebb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "id": "d3", "disk": 10}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:17.899876 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-37757cd4-3cb0-48f3-b9a9-6cc2bc5f4ebb admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.460549 Jul 27 07:42:17.901238 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 7/14] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 27 07:42:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 07:42:17.914792 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-54c90c22-f5cf-45ad-a8eb-c461a5adc754 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:17.942971 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-54c90c22-f5cf-45ad-a8eb-c461a5adc754 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031791 Jul 27 07:42:17.943533 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 8/15] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jul 27 07:42:17 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:42:20.184438 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-37757cd4-3cb0-48f3-b9a9-6cc2bc5f4ebb admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:20.185133 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-37757cd4-3cb0-48f3-b9a9-6cc2bc5f4ebb admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jul 27 07:42:20.186014 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 8/16] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 27 07:42:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:42:20.630904 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-b7d6a605-74c8-4bc1-afc3-969d3746c1b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 20, "vcpus": 4, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d4"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:20.653490 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-b7d6a605-74c8-4bc1-afc3-969d3746c1b9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.461304 Jul 27 07:42:20.655345 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 9/17] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 27 07:42:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 07:42:20.667732 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-9f79f2cb-8aed-4b59-b1bc-1f08ce84cf32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:20.696485 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-9f79f2cb-8aed-4b59-b1bc-1f08ce84cf32 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032680 Jul 27 07:42:20.699589 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 9/18] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jul 27 07:42:20 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:42:22.926296 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-b7d6a605-74c8-4bc1-afc3-969d3746c1b9 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:22.927825 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-b7d6a605-74c8-4bc1-afc3-969d3746c1b9 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002262 Jul 27 07:42:22.928585 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 10/19] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 27 07:42:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:42:23.354453 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-fff1e63a-a244-4d0d-a9ec-7ba68cb91c0e admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:23.380399 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-fff1e63a-a244-4d0d-a9ec-7ba68cb91c0e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.444388 Jul 27 07:42:23.380953 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 10/20] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jul 27 07:42:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:42:25.647903 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-b7d6a605-74c8-4bc1-afc3-969d3746c1b9 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:25.648853 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-b7d6a605-74c8-4bc1-afc3-969d3746c1b9 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 27 07:42:25.649254 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 11/21] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 27 07:42:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:42:26.079230 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-3b7f8731-64dd-442b-b0e2-5f5b1ebf728f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "ram": 512}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:26.099156 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-3b7f8731-64dd-442b-b0e2-5f5b1ebf728f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.444018 Jul 27 07:42:26.099731 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 11/22] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 27 07:42:25 2022] POST /compute/v2.1/flavors => generated 402 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 07:42:26.112535 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-061b6f26-e8b4-41d7-847a-2123570386d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:26.137415 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-061b6f26-e8b4-41d7-847a-2123570386d3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029220 Jul 27 07:42:26.137997 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 12/23] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jul 27 07:42:26 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:42:28.539815 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-3b7f8731-64dd-442b-b0e2-5f5b1ebf728f admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:28.540839 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-3b7f8731-64dd-442b-b0e2-5f5b1ebf728f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 27 07:42:28.541433 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 27 07:42:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:42:28.951753 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-e086a567-6f7c-42df-bf43-83db1d04cccb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "name": "m1.small", "vcpus": 1, "disk": 20, "id": "2", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:28.971518 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-e086a567-6f7c-42df-bf43-83db1d04cccb admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.424144 Jul 27 07:42:28.972056 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 13/25] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 27 07:42:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 07:42:28.984090 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-ba70d9e2-1c72-4013-b14b-60953f0d343e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:29.010904 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-ba70d9e2-1c72-4013-b14b-60953f0d343e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030509 Jul 27 07:42:29.011495 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 13/26] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jul 27 07:42:28 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:42:31.241412 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-e086a567-6f7c-42df-bf43-83db1d04cccb admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:31.242708 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-e086a567-6f7c-42df-bf43-83db1d04cccb admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001735 Jul 27 07:42:31.243230 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 14/27] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 27 07:42:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:42:31.639791 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-8f171de6-82f6-4e7d-bcab-eb1031b80f2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:31.660735 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-8f171de6-82f6-4e7d-bcab-eb1031b80f2c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.410728 Jul 27 07:42:31.661400 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 14/28] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 27 07:42:31 2022] POST /compute/v2.1/flavors => generated 406 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 07:42:31.674357 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-bbf349a5-e35a-448d-8654-7a11043c79d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:31.699656 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-bbf349a5-e35a-448d-8654-7a11043c79d0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029521 Jul 27 07:42:31.700239 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 15/29] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jul 27 07:42:31 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:42:34.004304 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-8f171de6-82f6-4e7d-bcab-eb1031b80f2c admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:34.005947 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-8f171de6-82f6-4e7d-bcab-eb1031b80f2c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002084 Jul 27 07:42:34.006502 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 15/30] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 27 07:42:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:42:34.533965 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-d3e7c805-15be-4537-a5ab-5e25d07544a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80, "vcpus": 4}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:34.556102 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-d3e7c805-15be-4537-a5ab-5e25d07544a5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.543501 Jul 27 07:42:34.564159 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 16/31] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 27 07:42:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 07:42:34.571362 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-8f789a1e-4b83-4587-a44a-ff2f9e47fc13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:34.600843 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-8f789a1e-4b83-4587-a44a-ff2f9e47fc13 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033103 Jul 27 07:42:34.615404 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 16/32] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jul 27 07:42:34 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:42:36.834511 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-d3e7c805-15be-4537-a5ab-5e25d07544a5 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:36.835564 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-d3e7c805-15be-4537-a5ab-5e25d07544a5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jul 27 07:42:36.835968 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 17/33] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 27 07:42:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:42:37.317657 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-2d434a01-bf31-4850-adbc-eb72148b128f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "os-flavor-access:is_public": true, "disk": 160, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384, "vcpus": 8, "rxtx_factor": 1.0}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:37.339418 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-2d434a01-bf31-4850-adbc-eb72148b128f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.497343 Jul 27 07:42:37.339976 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 17/34] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 27 07:42:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 07:42:37.352927 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-b95b8f64-6077-4878-81f0-ee56bd2d5009 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:42:37.357676 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:37.381021 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-b95b8f64-6077-4878-81f0-ee56bd2d5009 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031637 Jul 27 07:42:37.381840 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 18/35] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jul 27 07:42:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:42:57.237576 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-2d434a01-bf31-4850-adbc-eb72148b128f admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:57.238594 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-2d434a01-bf31-4850-adbc-eb72148b128f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001610 Jul 27 07:42:57.239062 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 18/36] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 27 07:42:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:42:57.250352 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:57.753435 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-d8749ac1-ff41-4a7c-85c5-ebb0fdea2094 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:57.771702 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-d8749ac1-ff41-4a7c-85c5-ebb0fdea2094 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.526448 Jul 27 07:42:57.772243 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 19/37] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jul 27 07:42:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:42:58.899736 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-2d434a01-bf31-4850-adbc-eb72148b128f admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:58.900745 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-2d434a01-bf31-4850-adbc-eb72148b128f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 27 07:42:58.901144 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 19/38] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 27 07:42:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:42:59.429144 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-047b1177-0a55-4fb3-a6e9-1da559f68009 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:59.434725 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.wsgi [None req-047b1177-0a55-4fb3-a6e9-1da559f68009 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-047b1177-0a55-4fb3-a6e9-1da559f68009 admin admin] Request method failure captured: Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Accept: application/json Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Accept-Encoding: gzip, deflate Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Connection: keep-alive Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Content-Length: 0 Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Host: 10.222.0.18 Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Openstack-Api-Version: compute 2.90 Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Openstack-System-Scope: None Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: User-Agent: python-novaclient Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Auth-Token: gAAAAABi4OyCEZWioeLnAQ8C7R-h6aRFm3MxQ7dDZSfAKjo0wdqMoD05z4mJQPO69wz35z3Jsun81ww2UkS424cHKxx_BixirfXcz2ct1TJYPHhcTILXpiFD1R7DibJyaoUtnRXpHXxG0aiSiA8zvL7lzmw8B5xnKJIVYF_5VginIOyuVpNs4pk Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Domain-Id: None Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Domain-Name: None Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Identity-Status: Confirmed Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Is-Admin-Project: True Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Project-Domain-Id: default Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Project-Domain-Name: Default Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Project-Id: b01056c5a4f74067a3bc2250b32736cc Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Project-Name: admin Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Role: reader,member,admin Jul 27 07:42:59.438637 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Roles: reader,member,admin Jul 27 07:42:59.440313 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:42:59.440313 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Tenant: admin Jul 27 07:42:59.440313 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Tenant-Id: b01056c5a4f74067a3bc2250b32736cc Jul 27 07:42:59.440313 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Tenant-Name: admin Jul 27 07:42:59.440313 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-User: admin Jul 27 07:42:59.440313 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-User-Domain-Id: default Jul 27 07:42:59.440313 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-User-Domain-Name: Default Jul 27 07:42:59.440313 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-User-Id: 0d288edc5a024ebe8b9e0a02e9598b35 Jul 27 07:42:59.440313 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-User-Name: admin Jul 27 07:42:59.440313 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: method: > Jul 27 07:42:59.440313 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: exception: Flavor 42 could not be found. Jul 27 07:42:59.440313 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: action_args: {'id': '42'} Jul 27 07:42:59.440313 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:42:59.440313 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:42:59.441310 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 07:42:59.441310 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 07:42:59.441310 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 07:42:59.441310 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 07:42:59.441310 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 07:42:59.441310 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 07:42:59.441310 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 07:42:59.441310 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 07:42:59.441310 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 07:42:59.441310 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:42:59.441310 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 07:42:59.441310 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 07:42:59.441310 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 27 07:42:59.441310 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 27 07:42:59.441310 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:42:59.441310 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 27 07:42:59.441310 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:42:59.441310 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:42:59.441310 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:42:59.442871 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:42:59.442871 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:42:59.442871 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:42:59.442871 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:42:59.442871 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 07:42:59.442871 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:42:59.442871 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 27 07:42:59.442871 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 27 07:42:59.442871 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:42:59.442871 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 27 07:42:59.442871 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:42:59.442871 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:42:59.442871 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:42:59.442871 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:42:59.442871 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:42:59.442871 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 27 07:42:59.442871 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 27 07:42:59.442871 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-047b1177-0a55-4fb3-a6e9-1da559f68009 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:42:59.444414 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-047b1177-0a55-4fb3-a6e9-1da559f68009 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.400799 Jul 27 07:42:59.444414 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 20/39] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jul 27 07:42:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 07:42:59.449738 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-a3646555-e787-45cc-8e18-16f0ea3c7704 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:59.454459 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:42:59.475375 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-a3646555-e787-45cc-8e18-16f0ea3c7704 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029196 Jul 27 07:42:59.476300 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 20/40] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jul 27 07:42:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:42:59.486295 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-31a42994-546a-4f06-b8fa-497bc16e031a admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:59.510439 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-31a42994-546a-4f06-b8fa-497bc16e031a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028357 Jul 27 07:42:59.510999 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 21/41] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jul 27 07:42:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:42:59.520953 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-4d1581f8-5dc5-4b95-a474-c46c384cc165 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:42:59.527610 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.wsgi [None req-4d1581f8-5dc5-4b95-a474-c46c384cc165 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-4d1581f8-5dc5-4b95-a474-c46c384cc165 admin admin] Request method failure captured: Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Accept: application/json Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Accept-Encoding: gzip, deflate Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Connection: keep-alive Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Content-Length: 0 Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Host: 10.222.0.18 Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Openstack-Api-Version: compute 2.90 Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Openstack-System-Scope: None Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: User-Agent: python-novaclient Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Auth-Token: gAAAAABi4OyCEZWioeLnAQ8C7R-h6aRFm3MxQ7dDZSfAKjo0wdqMoD05z4mJQPO69wz35z3Jsun81ww2UkS424cHKxx_BixirfXcz2ct1TJYPHhcTILXpiFD1R7DibJyaoUtnRXpHXxG0aiSiA8zvL7lzmw8B5xnKJIVYF_5VginIOyuVpNs4pk Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Domain-Id: None Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Domain-Name: None Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Identity-Status: Confirmed Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Is-Admin-Project: True Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Project-Domain-Id: default Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Project-Domain-Name: Default Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Project-Id: b01056c5a4f74067a3bc2250b32736cc Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Project-Name: admin Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Role: reader,member,admin Jul 27 07:42:59.531821 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Roles: reader,member,admin Jul 27 07:42:59.533244 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:42:59.533244 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Tenant: admin Jul 27 07:42:59.533244 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Tenant-Id: b01056c5a4f74067a3bc2250b32736cc Jul 27 07:42:59.533244 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Tenant-Name: admin Jul 27 07:42:59.533244 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-User: admin Jul 27 07:42:59.533244 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-User-Domain-Id: default Jul 27 07:42:59.533244 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-User-Domain-Name: Default Jul 27 07:42:59.533244 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-User-Id: 0d288edc5a024ebe8b9e0a02e9598b35 Jul 27 07:42:59.533244 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-User-Name: admin Jul 27 07:42:59.533244 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: method: > Jul 27 07:42:59.533244 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: exception: Flavor 42 could not be found. Jul 27 07:42:59.533244 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: action_args: {'id': '42'} Jul 27 07:42:59.533244 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:42:59.533244 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:42:59.534026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 07:42:59.534026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 07:42:59.534026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 07:42:59.534026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 07:42:59.534026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 07:42:59.534026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 07:42:59.534026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 07:42:59.534026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 07:42:59.534026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 07:42:59.534026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:42:59.534026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 07:42:59.534026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 07:42:59.534026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 27 07:42:59.534026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 27 07:42:59.534026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:42:59.534026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 27 07:42:59.534026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:42:59.534026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:42:59.534026 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:42:59.535074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:42:59.535074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:42:59.535074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:42:59.535074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:42:59.535074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 07:42:59.535074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:42:59.535074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 27 07:42:59.535074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 27 07:42:59.535074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:42:59.535074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 27 07:42:59.535074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:42:59.535074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:42:59.535074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:42:59.535074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:42:59.535074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:42:59.535074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 27 07:42:59.535074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 27 07:42:59.535074 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-4d1581f8-5dc5-4b95-a474-c46c384cc165 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:42:59.536085 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-4d1581f8-5dc5-4b95-a474-c46c384cc165 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016253 Jul 27 07:42:59.536085 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 21/42] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jul 27 07:42:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:00.503838 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-31a42994-546a-4f06-b8fa-497bc16e031a admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:43:00.504841 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-31a42994-546a-4f06-b8fa-497bc16e031a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 27 07:43:00.505239 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 22/43] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 27 07:43:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:43:01.030718 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-a7fb2de8-8903-436c-adfd-8e11b15cef71 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:43:01.036021 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.wsgi [None req-a7fb2de8-8903-436c-adfd-8e11b15cef71 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-a7fb2de8-8903-436c-adfd-8e11b15cef71 admin admin] Request method failure captured: Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Accept: application/json Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Accept-Encoding: gzip, deflate Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Connection: keep-alive Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Content-Length: 0 Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Host: 10.222.0.18 Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Openstack-Api-Version: compute 2.90 Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Openstack-System-Scope: None Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: User-Agent: python-novaclient Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Auth-Token: gAAAAABi4OyEkYagHD3dGjj6y4X2hjg_S9Cm4xabNIOswC9pkOxV6mRrhmrTuOQiSDZDiYJ_y2R_-i7uxgaEZkS-7kXirII0k_1mhPZTh5sxgt-lVqA7zG8t4ZdCfmBzxSSGrpywFW3tSTFo5xTtcI6xg0Kil6NEtnlD7jonOMwttXfk6OkLQ2I Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Domain-Id: None Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Domain-Name: None Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Identity-Status: Confirmed Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Is-Admin-Project: True Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Project-Domain-Id: default Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Project-Domain-Name: Default Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Project-Id: b01056c5a4f74067a3bc2250b32736cc Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Project-Name: admin Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Role: reader,member,admin Jul 27 07:43:01.037520 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Roles: reader,member,admin Jul 27 07:43:01.039032 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:43:01.039032 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Tenant: admin Jul 27 07:43:01.039032 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Tenant-Id: b01056c5a4f74067a3bc2250b32736cc Jul 27 07:43:01.039032 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Tenant-Name: admin Jul 27 07:43:01.039032 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-User: admin Jul 27 07:43:01.039032 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-User-Domain-Id: default Jul 27 07:43:01.039032 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-User-Domain-Name: Default Jul 27 07:43:01.039032 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-User-Id: 0d288edc5a024ebe8b9e0a02e9598b35 Jul 27 07:43:01.039032 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-User-Name: admin Jul 27 07:43:01.039032 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: method: > Jul 27 07:43:01.039032 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: exception: Flavor 84 could not be found. Jul 27 07:43:01.039032 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: action_args: {'id': '84'} Jul 27 07:43:01.039032 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:43:01.039032 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:43:01.040008 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 07:43:01.040008 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 07:43:01.040008 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 07:43:01.040008 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 07:43:01.040008 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 07:43:01.040008 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 07:43:01.040008 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 07:43:01.040008 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 07:43:01.040008 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 07:43:01.040008 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:43:01.040008 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 07:43:01.040008 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 07:43:01.040008 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 27 07:43:01.040008 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 27 07:43:01.040008 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:43:01.040008 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 27 07:43:01.040008 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:43:01.040008 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:43:01.040008 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:43:01.041286 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:43:01.041286 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:43:01.041286 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:43:01.041286 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:43:01.041286 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 07:43:01.041286 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:43:01.041286 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 27 07:43:01.041286 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 27 07:43:01.041286 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:43:01.041286 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 27 07:43:01.041286 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:43:01.041286 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:43:01.041286 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:43:01.041286 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:43:01.041286 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:43:01.041286 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 27 07:43:01.041286 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 27 07:43:01.041286 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-a7fb2de8-8903-436c-adfd-8e11b15cef71 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:43:01.042491 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-a7fb2de8-8903-436c-adfd-8e11b15cef71 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.396179 Jul 27 07:43:01.042491 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 22/44] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jul 27 07:43:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:01.049361 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-fa738723-134e-44c4-aaaa-ea72624171e9 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:43:01.064087 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-fa738723-134e-44c4-aaaa-ea72624171e9 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018957 Jul 27 07:43:01.064623 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 23/45] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jul 27 07:43:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:43:01.074100 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-097f55a0-7cf1-4413-a366-79d6954b8940 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:43:01.089188 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-097f55a0-7cf1-4413-a366-79d6954b8940 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018619 Jul 27 07:43:01.089715 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jul 27 07:43:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:43:01.099665 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-65a1625d-a01f-4d02-9692-2b766b48d887 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:43:01.104915 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.wsgi [None req-65a1625d-a01f-4d02-9692-2b766b48d887 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-65a1625d-a01f-4d02-9692-2b766b48d887 admin admin] Request method failure captured: Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Accept: application/json Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Accept-Encoding: gzip, deflate Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Connection: keep-alive Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Content-Length: 0 Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Host: 10.222.0.18 Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Openstack-Api-Version: compute 2.90 Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Openstack-System-Scope: None Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: User-Agent: python-novaclient Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Auth-Token: gAAAAABi4OyEkYagHD3dGjj6y4X2hjg_S9Cm4xabNIOswC9pkOxV6mRrhmrTuOQiSDZDiYJ_y2R_-i7uxgaEZkS-7kXirII0k_1mhPZTh5sxgt-lVqA7zG8t4ZdCfmBzxSSGrpywFW3tSTFo5xTtcI6xg0Kil6NEtnlD7jonOMwttXfk6OkLQ2I Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Domain-Id: None Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Domain-Name: None Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Identity-Status: Confirmed Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Is-Admin-Project: True Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Project-Domain-Id: default Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Project-Domain-Name: Default Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Project-Id: b01056c5a4f74067a3bc2250b32736cc Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Project-Name: admin Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Role: reader,member,admin Jul 27 07:43:01.106384 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Roles: reader,member,admin Jul 27 07:43:01.107950 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:43:01.107950 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Tenant: admin Jul 27 07:43:01.107950 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Tenant-Id: b01056c5a4f74067a3bc2250b32736cc Jul 27 07:43:01.107950 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Tenant-Name: admin Jul 27 07:43:01.107950 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-User: admin Jul 27 07:43:01.107950 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-User-Domain-Id: default Jul 27 07:43:01.107950 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-User-Domain-Name: Default Jul 27 07:43:01.107950 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-User-Id: 0d288edc5a024ebe8b9e0a02e9598b35 Jul 27 07:43:01.107950 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-User-Name: admin Jul 27 07:43:01.107950 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: method: > Jul 27 07:43:01.107950 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: exception: Flavor 84 could not be found. Jul 27 07:43:01.107950 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: action_args: {'id': '84'} Jul 27 07:43:01.107950 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:43:01.107950 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:43:01.109381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 07:43:01.109381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 07:43:01.109381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 07:43:01.109381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 07:43:01.109381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 07:43:01.109381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 07:43:01.109381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 07:43:01.109381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 07:43:01.109381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 07:43:01.109381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:43:01.109381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 07:43:01.109381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 07:43:01.109381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 27 07:43:01.109381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 27 07:43:01.109381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:43:01.109381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 27 07:43:01.109381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:43:01.109381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:43:01.109381 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:43:01.110410 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:43:01.110410 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:43:01.110410 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:43:01.110410 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:43:01.110410 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 07:43:01.110410 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:43:01.110410 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 27 07:43:01.110410 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 27 07:43:01.110410 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:43:01.110410 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 27 07:43:01.110410 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:43:01.110410 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:43:01.110410 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:43:01.110410 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:43:01.110410 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:43:01.110410 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 27 07:43:01.110410 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 27 07:43:01.110410 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-65a1625d-a01f-4d02-9692-2b766b48d887 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:43:01.111470 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-65a1625d-a01f-4d02-9692-2b766b48d887 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011620 Jul 27 07:43:01.111470 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 24/47] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jul 27 07:43:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 27 07:43:02.088619 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-097f55a0-7cf1-4413-a366-79d6954b8940 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:43:02.089629 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-097f55a0-7cf1-4413-a366-79d6954b8940 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 27 07:43:02.090029 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 24/48] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 27 07:43:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:43:02.634216 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-054713b8-a347-49dd-9cf9-f52466d0c759 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:43:02.640047 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.wsgi [None req-054713b8-a347-49dd-9cf9-f52466d0c759 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-054713b8-a347-49dd-9cf9-f52466d0c759 admin admin] Request method failure captured: Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Accept: application/json Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Accept-Encoding: gzip, deflate Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Connection: keep-alive Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Content-Length: 0 Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Host: 10.222.0.18 Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Openstack-Api-Version: compute 2.90 Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Openstack-System-Scope: None Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: User-Agent: python-novaclient Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Auth-Token: gAAAAABi4OyFWXDd1hIF8Wnkmlq4peNCVRCGyu2O6PUsjViMkIvgP0MoVcwfEmGOC98KVTxRBkwmFxqgL7Lnu4pC8JYYOsyeDkCFyH8OkAQtKhvObLqyn11X1FE-yLB8ms-SA77-p3shyb4gxILod7vMO-G4CKgtHQg9uRVIFFpJUzQSa87kseQ Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Domain-Id: None Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Domain-Name: None Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Identity-Status: Confirmed Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Is-Admin-Project: True Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Project-Domain-Id: default Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Project-Domain-Name: Default Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Project-Id: b01056c5a4f74067a3bc2250b32736cc Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Project-Name: admin Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Role: reader,member,admin Jul 27 07:43:02.641428 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Roles: reader,member,admin Jul 27 07:43:02.643062 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:43:02.643062 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Tenant: admin Jul 27 07:43:02.643062 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Tenant-Id: b01056c5a4f74067a3bc2250b32736cc Jul 27 07:43:02.643062 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-Tenant-Name: admin Jul 27 07:43:02.643062 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-User: admin Jul 27 07:43:02.643062 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-User-Domain-Id: default Jul 27 07:43:02.643062 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-User-Domain-Name: Default Jul 27 07:43:02.643062 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-User-Id: 0d288edc5a024ebe8b9e0a02e9598b35 Jul 27 07:43:02.643062 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: X-User-Name: admin Jul 27 07:43:02.643062 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: method: > Jul 27 07:43:02.643062 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: exception: Flavor 451 could not be found. Jul 27 07:43:02.643062 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: action_args: {'id': '451'} Jul 27 07:43:02.643062 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:43:02.643062 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:43:02.644054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 07:43:02.644054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 07:43:02.644054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 07:43:02.644054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 07:43:02.644054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 07:43:02.644054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 07:43:02.644054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 07:43:02.644054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 07:43:02.644054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 07:43:02.644054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:43:02.644054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 07:43:02.644054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 07:43:02.644054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 27 07:43:02.644054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 27 07:43:02.644054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:43:02.644054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 27 07:43:02.644054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:43:02.644054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:43:02.644054 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:43:02.645483 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:43:02.645483 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:43:02.645483 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:43:02.645483 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:43:02.645483 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 07:43:02.645483 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:43:02.645483 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 27 07:43:02.645483 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 27 07:43:02.645483 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:43:02.645483 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 27 07:43:02.645483 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:43:02.645483 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:43:02.645483 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:43:02.645483 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:43:02.645483 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:43:02.645483 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 27 07:43:02.645483 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 27 07:43:02.645483 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-054713b8-a347-49dd-9cf9-f52466d0c759 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:43:02.646763 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-054713b8-a347-49dd-9cf9-f52466d0c759 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.408723 Jul 27 07:43:02.646763 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 25/49] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jul 27 07:43:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 27 07:43:02.652403 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-c3854d71-bc88-4e7f-8bbd-a18dd945b921 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:43:02.667511 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-c3854d71-bc88-4e7f-8bbd-a18dd945b921 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018658 Jul 27 07:43:02.668041 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 25/50] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jul 27 07:43:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:43:02.677702 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-bf148382-9803-4554-81cc-0f489f0210bf admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:43:02.692329 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-bf148382-9803-4554-81cc-0f489f0210bf admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018073 Jul 27 07:43:02.692841 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 26/51] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jul 27 07:43:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:43:02.701789 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-e6aef361-ebe0-4088-8af1-86c09c11b3a6 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:43:02.707021 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.wsgi [None req-e6aef361-ebe0-4088-8af1-86c09c11b3a6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-e6aef361-ebe0-4088-8af1-86c09c11b3a6 admin admin] Request method failure captured: Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Accept: application/json Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Accept-Encoding: gzip, deflate Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Connection: keep-alive Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Content-Length: 0 Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Host: 10.222.0.18 Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Openstack-Api-Version: compute 2.90 Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Openstack-System-Scope: None Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: User-Agent: python-novaclient Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Auth-Token: gAAAAABi4OyFWXDd1hIF8Wnkmlq4peNCVRCGyu2O6PUsjViMkIvgP0MoVcwfEmGOC98KVTxRBkwmFxqgL7Lnu4pC8JYYOsyeDkCFyH8OkAQtKhvObLqyn11X1FE-yLB8ms-SA77-p3shyb4gxILod7vMO-G4CKgtHQg9uRVIFFpJUzQSa87kseQ Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Domain-Id: None Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Domain-Name: None Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Identity-Status: Confirmed Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Is-Admin-Project: True Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Project-Domain-Id: default Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Project-Domain-Name: Default Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Project-Id: b01056c5a4f74067a3bc2250b32736cc Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Project-Name: admin Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Role: reader,member,admin Jul 27 07:43:02.708507 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Roles: reader,member,admin Jul 27 07:43:02.710031 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b01056c5a4f74067a3bc2250b32736cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:43:02.710031 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Tenant: admin Jul 27 07:43:02.710031 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Tenant-Id: b01056c5a4f74067a3bc2250b32736cc Jul 27 07:43:02.710031 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-Tenant-Name: admin Jul 27 07:43:02.710031 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-User: admin Jul 27 07:43:02.710031 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-User-Domain-Id: default Jul 27 07:43:02.710031 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-User-Domain-Name: Default Jul 27 07:43:02.710031 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-User-Id: 0d288edc5a024ebe8b9e0a02e9598b35 Jul 27 07:43:02.710031 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: X-User-Name: admin Jul 27 07:43:02.710031 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: method: > Jul 27 07:43:02.710031 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: exception: Flavor 451 could not be found. Jul 27 07:43:02.710031 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: action_args: {'id': '451'} Jul 27 07:43:02.710031 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:43:02.710031 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:43:02.711265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 07:43:02.711265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 07:43:02.711265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 07:43:02.711265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 07:43:02.711265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 07:43:02.711265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 07:43:02.711265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 07:43:02.711265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 07:43:02.711265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 07:43:02.711265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:43:02.711265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 07:43:02.711265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 07:43:02.711265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 27 07:43:02.711265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 27 07:43:02.711265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:43:02.711265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 27 07:43:02.711265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:43:02.711265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:43:02.711265 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:43:02.712603 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:43:02.712603 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:43:02.712603 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:43:02.712603 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:43:02.712603 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 07:43:02.712603 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:43:02.712603 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 27 07:43:02.712603 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 27 07:43:02.712603 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:43:02.712603 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 27 07:43:02.712603 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:43:02.712603 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:43:02.712603 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:43:02.712603 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:43:02.712603 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:43:02.712603 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 27 07:43:02.712603 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Jul 27 07:43:02.712603 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-e6aef361-ebe0-4088-8af1-86c09c11b3a6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:43:02.713831 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-e6aef361-ebe0-4088-8af1-86c09c11b3a6 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011566 Jul 27 07:43:02.713831 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 26/52] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jul 27 07:43:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 07:43:03.687970 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-bf148382-9803-4554-81cc-0f489f0210bf admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:43:03.688975 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-bf148382-9803-4554-81cc-0f489f0210bf admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 27 07:43:03.689363 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 27/53] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 27 07:43:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:43:04.208749 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-dca87a7d-3eed-41cc-a2e4-0b39f1edb7f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:43:04.227608 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-dca87a7d-3eed-41cc-a2e4-0b39f1edb7f3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.401003 Jul 27 07:43:04.228152 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 27/54] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jul 27 07:43:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 07:43:05.225708 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-bf148382-9803-4554-81cc-0f489f0210bf admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:43:05.226701 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-bf148382-9803-4554-81cc-0f489f0210bf admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jul 27 07:43:05.227139 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 28/55] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 27 07:43:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:43:05.883113 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-ce49b193-feea-4e4d-a269-12733972f39e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:43:05.902130 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-ce49b193-feea-4e4d-a269-12733972f39e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.535903 Jul 27 07:43:05.902600 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 28/56] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jul 27 07:43:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 07:43:06.901599 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-bf148382-9803-4554-81cc-0f489f0210bf admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:43:06.902617 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-bf148382-9803-4554-81cc-0f489f0210bf admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 27 07:43:06.903044 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 29/57] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 27 07:43:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:43:07.445987 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-a889f8bd-4531-4c4f-9f5d-5557a84cb41b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:43:07.465444 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-a889f8bd-4531-4c4f-9f5d-5557a84cb41b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.414984 Jul 27 07:43:07.465998 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 29/58] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jul 27 07:43:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 07:43:08.438214 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-bf148382-9803-4554-81cc-0f489f0210bf admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:43:08.439275 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-bf148382-9803-4554-81cc-0f489f0210bf admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 27 07:43:08.439665 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 30/59] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 27 07:43:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:43:08.958049 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-c1a08f8c-e309-4882-a86f-f8feb30c94e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:43:08.976399 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-c1a08f8c-e309-4882-a86f-f8feb30c94e9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.397726 Jul 27 07:43:08.976962 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 30/60] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jul 27 07:43:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 07:43:09.957200 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-bf148382-9803-4554-81cc-0f489f0210bf admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:43:09.958193 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-bf148382-9803-4554-81cc-0f489f0210bf admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jul 27 07:43:09.958580 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 31/61] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 27 07:43:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:43:10.480321 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-0b56e6c4-e804-4341-85c5-3b02e6f38619 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:43:10.501765 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-0b56e6c4-e804-4341-85c5-3b02e6f38619 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.408246 Jul 27 07:43:10.502313 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 31/62] 10.222.0.18 () {60 vars in 1202 bytes} [Wed Jul 27 07:43:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:44:02.377192 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-bf148382-9803-4554-81cc-0f489f0210bf admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:44:02.378225 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-bf148382-9803-4554-81cc-0f489f0210bf admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 27 07:44:02.378632 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 32/63] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 27 07:44:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:44:02.388717 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:44:02.779800 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-39ba41e5-9404-400e-9868-940caf35bb66 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:44:02.799682 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-39ba41e5-9404-400e-9868-940caf35bb66 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.415393 Jul 27 07:44:02.800226 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 32/64] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jul 27 07:44:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:44:02.821043 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_api:SELECT=14 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:44:02.825121 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-0e93829a-4c79-4f06-9fc8-b6c8c8e552db admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:44:02.833655 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-0e93829a-4c79-4f06-9fc8-b6c8c8e552db admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014073 Jul 27 07:44:02.834198 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 33/65] 10.222.0.18 () {60 vars in 1282 bytes} [Wed Jul 27 07:44:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:44:02.846193 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-4420c35f-3cdb-4ea7-8dae-b6b3adc84888 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:44:02.853779 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-4420c35f-3cdb-4ea7-8dae-b6b3adc84888 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011482 Jul 27 07:44:02.854288 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 33/66] 10.222.0.18 () {60 vars in 1285 bytes} [Wed Jul 27 07:44:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:44:02.865410 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-66341056-cecb-4746-bd55-6a70de62bccd admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:44:02.872889 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-66341056-cecb-4746-bd55-6a70de62bccd admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011015 Jul 27 07:44:02.873931 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 34/67] 10.222.0.18 () {60 vars in 1285 bytes} [Wed Jul 27 07:44:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:44:02.885261 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-59b88962-7146-4d71-85f5-74c04b182b24 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:44:02.893723 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-59b88962-7146-4d71-85f5-74c04b182b24 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012072 Jul 27 07:44:02.894257 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 34/68] 10.222.0.18 () {60 vars in 1282 bytes} [Wed Jul 27 07:44:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:47:25.137456 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-66341056-cecb-4746-bd55-6a70de62bccd admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:47:25.138462 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-66341056-cecb-4746-bd55-6a70de62bccd admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 27 07:47:25.138856 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 35/69] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 27 07:47:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:47:25.287150 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_api:SELECT=6 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:47:25.451824 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-e04f1012-e8ef-418b-8ca2-1dc1d5a89569 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:47:25.454128 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:47:25.454128 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: warnings.warn(msg) Jul 27 07:47:25.455361 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-e04f1012-e8ef-418b-8ca2-1dc1d5a89569 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:47:25.455791 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-e04f1012-e8ef-418b-8ca2-1dc1d5a89569 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:47:25.456565 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-e04f1012-e8ef-418b-8ca2-1dc1d5a89569 admin admin] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:47:25.456987 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-e04f1012-e8ef-418b-8ca2-1dc1d5a89569 admin admin] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:47:25.491034 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-e04f1012-e8ef-418b-8ca2-1dc1d5a89569 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.205419 Jul 27 07:47:25.491583 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 35/70] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jul 27 07:47:25 2022] GET /compute/v2.1/os-services => generated 794 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 07:47:26.330105 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-66341056-cecb-4746-bd55-6a70de62bccd admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:47:26.331145 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-66341056-cecb-4746-bd55-6a70de62bccd admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jul 27 07:47:26.331543 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 36/71] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 27 07:47:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:47:26.524717 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-8f3b4bbf-cfe7-4ecf-9a84-323b44b1a692 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:47:26.527078 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:47:26.527078 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: warnings.warn(msg) Jul 27 07:47:26.528262 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-8f3b4bbf-cfe7-4ecf-9a84-323b44b1a692 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:47:26.528697 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-8f3b4bbf-cfe7-4ecf-9a84-323b44b1a692 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:47:26.529496 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-8f3b4bbf-cfe7-4ecf-9a84-323b44b1a692 admin admin] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:47:26.529912 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-8f3b4bbf-cfe7-4ecf-9a84-323b44b1a692 admin admin] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:47:26.550289 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-8f3b4bbf-cfe7-4ecf-9a84-323b44b1a692 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077648 Jul 27 07:47:26.550810 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 36/72] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jul 27 07:47:26 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 07:47:37.835680 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-66341056-cecb-4746-bd55-6a70de62bccd admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:47:37.836681 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-66341056-cecb-4746-bd55-6a70de62bccd admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 27 07:47:37.837071 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 37/73] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 27 07:47:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:47:37.980907 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_cell0:SELECT=4 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:47:37.981620 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_cell1:SELECT=4 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:47:37.982231 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG dbcounter [-] [103265] Writing DB stats nova_api:SELECT=8 {{(pid=103265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:47:38.030585 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-cefb2cb8-5e44-47dd-8498-a81e64844249 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:47:38.033053 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:47:38.033053 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: warnings.warn(msg) Jul 27 07:47:38.034252 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-cefb2cb8-5e44-47dd-8498-a81e64844249 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:47:38.034701 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-cefb2cb8-5e44-47dd-8498-a81e64844249 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:47:38.035501 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-cefb2cb8-5e44-47dd-8498-a81e64844249 admin admin] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:47:38.035931 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-cefb2cb8-5e44-47dd-8498-a81e64844249 admin admin] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:47:38.061573 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-cefb2cb8-5e44-47dd-8498-a81e64844249 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.085742 Jul 27 07:47:38.062133 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 37/74] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jul 27 07:47:37 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:47:38.898593 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-66341056-cecb-4746-bd55-6a70de62bccd admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:47:38.899633 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-66341056-cecb-4746-bd55-6a70de62bccd admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 27 07:47:38.900548 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 38/75] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 27 07:47:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:47:39.092326 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-b67cdcd0-7351-4c93-b2a7-546919ca4305 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:47:39.094726 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 07:47:39.094726 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: warnings.warn(msg) Jul 27 07:47:39.096617 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-b67cdcd0-7351-4c93-b2a7-546919ca4305 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:47:39.096617 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-b67cdcd0-7351-4c93-b2a7-546919ca4305 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:47:39.097153 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-b67cdcd0-7351-4c93-b2a7-546919ca4305 admin admin] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:47:39.097574 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-b67cdcd0-7351-4c93-b2a7-546919ca4305 admin admin] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:47:39.129287 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-b67cdcd0-7351-4c93-b2a7-546919ca4305 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.090405 Jul 27 07:47:39.130065 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 38/76] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jul 27 07:47:39 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:48:35.560664 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: Wed Jul 27 07:48:35 2022 - graceful shutdown triggered... Jul 27 07:48:35.561182 dv-cinder-825492-32-iscsi devstack@n-api.service[103265]: Gracefully killing worker 1 (pid: 103265)... Jul 27 07:48:35.561576 dv-cinder-825492-32-iscsi devstack@n-api.service[103266]: Gracefully killing worker 2 (pid: 103266)... Jul 27 07:48:35.562564 dv-cinder-825492-32-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 27 07:48:36.561813 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: worker 1 buried after 1 seconds Jul 27 07:48:36.562366 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: worker 2 buried after 1 seconds Jul 27 07:48:36.562366 dv-cinder-825492-32-iscsi devstack@n-api.service[103264]: goodbye to uWSGI. Jul 27 07:48:36.563438 dv-cinder-825492-32-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 27 07:48:36.564021 dv-cinder-825492-32-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 27 07:48:36.566860 dv-cinder-825492-32-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 07:48:36.578275 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 07:48:36.580351 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 07:48:36 2022] *** Jul 27 07:48:36.580351 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 07:48:36.580351 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 07:48:36.580351 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: nodename: dv-cinder-825492-32-iscsi Jul 27 07:48:36.580351 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: machine: x86_64 Jul 27 07:48:36.580351 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: clock source: unix Jul 27 07:48:36.580351 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: pcre jit disabled Jul 27 07:48:36.580351 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: detected number of CPU cores: 4 Jul 27 07:48:36.580351 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: current working directory: / Jul 27 07:48:36.580351 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: detected binary path: /usr/bin/uwsgi-core Jul 27 07:48:36.580351 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: your processes number limit is 47680 Jul 27 07:48:36.581066 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: your memory page size is 4096 bytes Jul 27 07:48:36.581066 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: detected max file descriptor number: 2048 Jul 27 07:48:36.581066 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: lock engine: pthread robust mutexes Jul 27 07:48:36.581066 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: thunder lock: enabled Jul 27 07:48:36.581066 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 07:48:36.581066 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 07:48:36.621093 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: Python main interpreter initialized at 0x556c2b6a99c0 Jul 27 07:48:36.621093 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: python threads support enabled Jul 27 07:48:36.621093 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: your server socket listen backlog is limited to 100 connections Jul 27 07:48:36.621093 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: your mercy for graceful operations on workers is 90 seconds Jul 27 07:48:36.621549 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 07:48:36.621549 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: *** Operational MODE: preforking *** Jul 27 07:48:36.621818 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: *** uWSGI is running in multiple interpreter mode *** Jul 27 07:48:36.621818 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: spawned uWSGI master process (pid: 117767) Jul 27 07:48:36.622028 dv-cinder-825492-32-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 07:48:36.622661 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: spawned uWSGI worker 1 (pid: 117779, cores: 1) Jul 27 07:48:36.626928 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: spawned uWSGI worker 2 (pid: 117780, cores: 1) Jul 27 07:48:36.626928 dv-cinder-825492-32-iscsi devstack@n-api.service[117767]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 07:48:37.287696 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 07:48:37.298372 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 07:48:38.468396 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 07:48:38.468396 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: from cryptography.utils import int_from_bytes Jul 27 07:48:38.469160 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 07:48:38.469160 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: from cryptography.utils import int_from_bytes Jul 27 07:48:38.478585 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 07:48:38.478585 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: from cryptography.utils import int_from_bytes Jul 27 07:48:38.479404 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 07:48:38.479404 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: from cryptography.utils import int_from_bytes Jul 27 07:48:40.917909 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 07:48:40.918542 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 07:48:40.918806 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 07:48:40.919096 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 07:48:40.919355 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 07:48:40.919740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.920262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.920768 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.921177 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.921516 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.921826 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.922318 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.922643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.923010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.923277 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.923597 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.923924 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-32-iscsi {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.924249 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.924736 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.925050 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.925374 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.925707 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.925996 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.926302 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.926804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.928202 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.928202 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.928405 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.928618 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.928929 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.929781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.930117 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.930428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.930748 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.931092 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.931494 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-32-iscsi {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.931983 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.932481 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.932779 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.933202 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.933528 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.933838 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.934157 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.934526 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.935013 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.935508 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.935825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.936393 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.936719 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.937023 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.937332 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.937672 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.937960 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.938267 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.938576 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.938824 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.939163 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.939486 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.939805 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.940131 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.940377 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.940623 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.940946 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.941264 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.941571 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.941888 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.942179 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.942496 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.942788 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.943118 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.943422 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.943724 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.944037 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.944349 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.944705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.945525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.945840 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.946239 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.946490 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.946794 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.947164 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.947483 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.947788 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.948105 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.948428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.948734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.949039 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.949341 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.949656 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.949986 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.950287 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.950452 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 07:48:40.951009 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.951172 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 07:48:40.951349 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.951349 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.951659 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 07:48:40.951825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.952006 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 07:48:40.952167 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.952324 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 07:48:40.952508 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.952669 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.952832 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.952989 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.953168 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.953323 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.953496 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.953651 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.953861 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.954020 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.954175 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.954363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.954521 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.954681 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.954853 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.955052 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.955208 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.955365 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.955518 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.955678 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.955865 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.956033 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.956191 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.957148 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-32-iscsi {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.957314 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.957472 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.957620 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.957620 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.957902 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.958057 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.958210 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.958408 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.958567 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.958715 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.958901 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.959125 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.959291 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.959454 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.959608 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.959761 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.959761 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.960084 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.960256 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.960409 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.960568 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.960739 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.960893 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.961040 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.961191 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.961337 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.961502 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.961662 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.961817 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.961971 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.962125 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.962277 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.962470 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.962629 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.962797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.962975 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.963127 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.963274 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.963432 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.963432 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.963724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-32-iscsi {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.963880 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.964033 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.964188 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.964340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.964494 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.964659 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.964816 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.964962 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.965118 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.965264 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.965409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.965560 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.965713 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.965868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.966026 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.966172 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.966317 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.966489 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.967393 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.967393 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.967718 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.967873 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.968028 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.968187 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.968333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.968488 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.968635 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.968635 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.968913 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.969065 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.969221 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.969402 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.969558 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.969717 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.969864 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.970052 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.970209 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.970355 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.970547 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.970706 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.970860 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.971051 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.971276 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.971451 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.971602 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.971755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.971967 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.972127 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.972289 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.972435 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.972588 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.972740 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.972890 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.973075 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.973226 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.973390 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.973545 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.973701 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.974153 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.974322 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.974510 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.974666 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.974817 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.975008 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.975200 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.975362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.975510 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.975665 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.975821 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.976043 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.976198 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.976359 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.976507 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.976659 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.977548 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.977729 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.977895 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.978043 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.978197 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.978342 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.978544 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.978697 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.978855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.979062 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.979212 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.979358 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.979605 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.979756 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.979915 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.980069 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.980216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.980361 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.980467 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.980564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.980765 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.980863 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.980959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.981043 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.981127 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.981219 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.981312 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.981401 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.981563 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.981712 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.981867 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.982034 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.982188 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.982334 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.982488 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.982642 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.982796 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.982972 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.983132 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.983284 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.983430 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.983574 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.983734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.983882 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.984045 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.984197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.984197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.984197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.984197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.984197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.984961 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.985116 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.985268 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.985414 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.985569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.985722 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.985869 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.986068 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.986220 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.986373 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.986529 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.986809 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.987763 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.987966 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.988127 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.988329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.988494 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.988652 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.988799 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.988955 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.989119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.989279 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.989426 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.989585 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.989740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.989887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.990033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.990191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.990348 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.990539 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.990691 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.990842 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.991036 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.991205 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.991360 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.992045 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.992200 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.992355 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.992502 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.992647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.992800 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.992953 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.993108 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.993264 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.993421 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.993610 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.993758 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.993917 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.994065 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.994220 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.994368 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.994522 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.994676 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.994823 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.994993 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.995159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.995309 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.995462 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.995627 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.995783 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.995942 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.996099 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.996246 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.996402 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.996556 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.996702 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.996702 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.997001 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.997881 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.998043 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.998191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.998349 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.998513 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.998669 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.998815 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.999019 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.999176 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.999411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:40.999578 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:40.999752 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.000475 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:41.000634 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.000781 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 07:48:41.001012 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.001173 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.001331 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.001478 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.001633 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.001780 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.001946 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.002138 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.002297 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.002454 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.002603 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.002785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.002965 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.003158 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.003437 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.003605 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.003756 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.003917 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.004113 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.004113 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.004414 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.004561 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.004712 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.004872 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.005019 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.005172 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.005477 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.005477 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.005773 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.005933 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.006089 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.006242 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.006388 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.006540 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.006727 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.006976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.007173 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.008062 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.008232 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.008399 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.008562 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.008716 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.008873 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.008873 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.009161 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.009306 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.009464 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.009618 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.009772 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.010211 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.010450 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.010613 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.010774 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.010940 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.011094 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.011251 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.011412 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.011559 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.011713 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.011860 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.012023 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.012182 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.012328 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.012488 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.012657 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.012812 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.012958 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.013104 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.013249 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.013410 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.013564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.013719 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.013872 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.014026 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.014180 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.014340 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.014495 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.014653 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.014806 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.015027 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.015178 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.015335 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.015506 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.015724 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.015885 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.016040 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.016193 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.016353 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.016499 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.016645 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.016807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.016964 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.017126 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.017274 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.017419 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.017666 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.018255 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.018439 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.019047 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.019221 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.019370 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.019528 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.019674 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.019831 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.019987 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.020167 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.020324 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.020481 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.020627 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.020780 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.020936 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.021081 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.021226 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.021370 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.021523 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.021698 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.021852 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.022003 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.022155 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.022302 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.022474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.024264 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.024442 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.024614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.024947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.025104 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.025261 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.025424 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.025589 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.025763 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.025763 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.026132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.026280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.026440 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.026598 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.026746 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.026913 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.027065 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.027231 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.027380 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.027534 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.027781 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.027956 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.028559 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.028830 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.028985 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.029131 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.029283 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.029430 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.029584 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.029741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.029888 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.030034 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.030179 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.030344 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.030498 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.030659 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.030806 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.030975 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.031125 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.031282 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.031443 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.031590 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.031736 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.034247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.035102 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.035488 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.035652 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.035814 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.036025 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.036280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.036445 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.036595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.036749 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.036897 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.037680 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.037940 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.038106 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.038933 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.039334 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.039513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.039753 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.039904 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.040050 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.040204 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.040358 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.040507 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.040662 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.040819 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.040982 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.041149 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.041304 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.041453 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.041612 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.041760 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.041906 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.042052 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.042199 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.042366 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.042525 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.042679 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.042834 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.043091 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.043252 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.043408 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.043571 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.043741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.043903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.044073 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.044226 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.044388 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.044548 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.044548 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.044841 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.044994 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.045146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.045318 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.045479 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.045641 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.045906 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.046080 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.046264 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.046512 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.046609 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.046693 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.046779 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.046862 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.047034 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.047217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.047380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.047534 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.047698 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.047853 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.048107 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.048273 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.048554 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.049115 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.049239 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.049335 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.049428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.049528 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.049614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.049707 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.049807 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.049899 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.049992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.050084 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.050311 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.050311 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.050499 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.050592 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.050677 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.050769 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.050855 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.050974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.051069 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.051201 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.051296 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.051388 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.051480 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.051579 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.051665 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.051756 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.051840 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.051936 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.052030 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.052123 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.052284 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.052385 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.052477 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.052569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.052663 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.052755 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.052847 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.052932 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.053024 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.053119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.053216 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.053301 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.053393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.053485 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.053577 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.053669 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.053766 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.053858 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.053944 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.054560 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.054647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.054745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.054831 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.055075 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.055177 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.055263 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.055347 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.055440 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.055532 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.055617 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.055708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.055801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.055886 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.055990 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.055990 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.056155 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.056283 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.056386 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.056501 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.056589 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.056681 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.056774 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.056869 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.056954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.057047 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.057140 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.057233 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.057317 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.057400 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.057483 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.057580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.057672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.057757 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.057840 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.057923 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.058005 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.058245 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.058343 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.058438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.058545 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.058633 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.058985 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.059149 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.059286 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.059383 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.059476 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.059562 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.059659 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.059752 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.059832 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.059909 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.059987 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.060072 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.060168 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.060255 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.060370 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.060507 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.060507 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.060680 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.060680 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.060853 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.060853 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.060997 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.061089 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.061174 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.061268 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.061361 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.061446 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.061530 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.061621 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.061717 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.061802 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.061882 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.061954 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.062037 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.062109 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.062188 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.062268 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.062352 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.062443 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.062534 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.062619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.062715 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.062805 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.062915 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.063005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.063079 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.063174 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.063275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.063368 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.063455 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.063528 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.063618 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.063711 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.063796 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.063879 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.063969 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.064054 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.064145 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.064243 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.064335 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.064419 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.064510 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.064594 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.064677 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.064763 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.064837 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.064927 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.065019 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.065112 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.065112 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.065273 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.065359 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.065450 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.065535 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.065625 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.065722 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.065807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.065891 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.065981 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.066066 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.066177 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.066274 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.066366 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.066458 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.066543 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.066626 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.066709 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.066806 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.066917 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.067006 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.067103 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.067194 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.067279 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.067363 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.067454 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.067540 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.067638 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.067738 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.067832 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.067925 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.068017 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.068102 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.068198 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.068303 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.068386 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.068479 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.068570 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.068654 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.068746 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.069065 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.069210 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.069334 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.069428 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.069530 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.069637 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.069781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.069869 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.069953 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.070037 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.070130 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.070224 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.070309 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.070399 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.070491 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.070619 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.070723 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.070818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.070960 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.071049 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.071134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.071218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.071315 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.071409 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.071495 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.071578 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.071661 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.071661 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.071835 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.071922 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.072005 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.072181 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.072276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.072376 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.072468 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.072595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.072733 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.072854 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.072974 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.073114 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.073231 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.073345 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.073459 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.073581 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.073696 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.073696 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.073933 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.073933 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.074157 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.074271 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.074397 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.074513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.074626 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.074745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.074859 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.074997 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.075132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.075247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.075360 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.075480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.075601 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.075715 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.075837 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.075837 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.076059 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.076175 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.076297 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.076417 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.076613 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.076738 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.076861 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.077002 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.077092 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.077185 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.077277 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.077363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.077454 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.077539 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.077629 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.077770 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.077887 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.077887 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.078037 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.078116 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.078188 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.078271 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.078350 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.078476 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.078569 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.078681 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.078769 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.078769 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.079758 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.079913 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.079913 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.079913 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.079913 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.080352 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.080466 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.080587 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.080732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.080732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.080956 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.081051 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.081145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.081230 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.081321 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.081413 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.081508 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.081592 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.081676 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.081767 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.081852 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.081935 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.082028 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.082121 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.082207 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.082339 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.082439 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.082523 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.082596 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.082673 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.082751 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.082834 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.082925 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.083018 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.083092 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.083162 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.083272 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.083363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.083443 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.083525 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.083604 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.083744 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.083896 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.084068 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.084220 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.084381 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.084635 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.084719 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.084957 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.085077 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.085861 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.085976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.086192 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.086293 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.086503 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.086595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.086809 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.086945 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.087143 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.087247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.087453 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.087648 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.087763 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.087851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.088052 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.088145 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.088374 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.088474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.088680 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.088777 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.088991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.089110 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.089335 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.089468 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.089595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.089697 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.089904 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.089996 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.090207 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.090312 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.090513 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.090614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.090813 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.090930 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.091162 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.091267 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.091473 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.091573 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.091792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.091886 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.092112 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.092219 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.092416 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.092510 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.092726 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.092824 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.093032 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.093124 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.093334 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.093434 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.093638 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.093738 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.093940 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.094033 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.094247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.094346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.094560 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.094660 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.094873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.094988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.095206 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.095300 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.095519 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.095621 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.095829 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.095922 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.096132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.096238 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.096441 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.096536 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.096752 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.096846 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.097058 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.097152 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.097375 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.097478 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.097677 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.097771 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.097978 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.098070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.098285 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.098379 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.098585 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.098724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.099176 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.099299 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.099487 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.099587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.099798 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.099919 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.100099 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.100234 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.100402 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.100546 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.100703 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.100934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.101576 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.101765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.101885 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.102081 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.102206 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.102400 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.102516 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.102719 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.102813 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.103051 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.103158 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.103513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.103625 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.103761 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.103862 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.104064 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.104157 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.104374 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.104481 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.104681 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.104781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.104987 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.105088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.105297 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.105404 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.105606 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.105712 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.105914 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.106043 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.106218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.106356 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.106522 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.106653 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.106832 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.106993 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.107162 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.107264 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.107472 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.107564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.107784 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.107876 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.108096 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.108190 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.108403 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.108503 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.108714 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.108884 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.109023 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.109195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.109335 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.109561 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.109822 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.109919 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.110144 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.110239 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.110467 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.110561 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.110773 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.110899 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.111113 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.111210 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.111422 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.111515 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.111734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.111841 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.112045 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.112142 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.112357 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.112450 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.112666 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.112773 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.112972 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.113065 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.113296 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.113398 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.113616 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.113716 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.113929 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.114030 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.114251 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.114402 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.114564 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.114657 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.114876 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.114989 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.115209 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.115332 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.115524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.115836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.115926 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.116012 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.116178 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.116286 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.116518 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.116624 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.116844 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.116938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.117160 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.117266 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.117469 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.117563 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.117778 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.117877 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.118087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.118193 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.118397 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.118489 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.118707 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.118809 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.119041 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.119140 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.119350 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.119444 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.119665 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.119821 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.119975 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.120104 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.120276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.120414 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.120599 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.120693 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.120912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.121007 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.121222 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.121314 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.121532 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.121626 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.121836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.121937 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.122160 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.122345 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.122471 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.122656 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.122780 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.123009 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.123119 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.123336 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.123430 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.123660 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.123755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.123977 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.124070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.124293 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.124386 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.124618 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.124712 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.124924 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.125018 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.125228 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.125408 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.125541 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.125641 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.125850 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.125951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.126153 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.126255 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.126475 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.126575 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.126785 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.126877 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.127117 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.127224 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.127423 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.127516 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.127732 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.127824 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.128034 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.128260 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.128362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.128606 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.128708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.128919 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.129075 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.129222 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.129374 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.129527 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.129649 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.129849 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.129993 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.130148 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.130268 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.130451 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.130561 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.130771 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.130875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.131110 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.131205 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.131423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.131518 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.131728 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.131834 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.132029 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.132149 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.132360 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.132456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.132670 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.132765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.132976 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.133088 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.133280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.133381 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.133588 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.133690 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.133889 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.133983 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.134211 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.134304 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.134516 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.134610 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.134820 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.134944 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.135172 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.135304 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.135483 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.135588 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.135786 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.135880 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.136090 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.136192 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.136392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.136494 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.136695 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.136795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.137003 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.137105 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.137302 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.137396 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.137609 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.137702 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.137912 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.138017 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.138219 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.138466 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.138559 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.138796 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.138959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.139141 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.139244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.139460 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.139574 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.139773 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.139939 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.140078 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.140171 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.140394 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.140504 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.140706 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.140814 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.141020 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.141115 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.141336 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.141466 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.141648 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.141756 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.141978 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.142073 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.142302 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.142448 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.142629 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.142840 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.142988 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.143214 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.143307 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.143533 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.143635 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.143863 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.143966 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.144192 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.144294 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.144535 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.144643 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.144841 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.144941 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.145144 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.145238 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.145465 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.145559 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.145778 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.145929 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.146090 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.146195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.146418 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.146514 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.146709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.146801 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.147044 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.147141 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.147354 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.147498 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.147665 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.148330 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.148503 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.148637 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.148796 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.148893 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.149138 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.149324 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.149468 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.149642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.149803 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.150041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.150137 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.150354 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.150493 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.150668 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.150771 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.151054 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.151251 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.151585 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.151731 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.151909 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.152032 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.152249 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.152361 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.152567 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.152676 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.152880 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.153162 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.153255 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.153518 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.153612 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.153829 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.153923 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.154189 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.154296 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.154472 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.154574 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.154785 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.154928 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.155118 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.155212 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.155487 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.155663 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.155799 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.155892 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.156129 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.156223 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.156444 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.156551 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.156752 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.156852 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.157070 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.157171 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.157382 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.157486 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.157688 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.157923 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.158017 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.158320 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.158488 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.158587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.158675 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.158935 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.159035 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.159268 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.159443 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.159593 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.159797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.159904 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.159983 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.160187 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.160324 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.160518 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.160756 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.160860 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.161071 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.161240 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.161391 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.161494 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.161716 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.161825 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.162006 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.162110 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.162311 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.162412 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.163190 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.163306 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.163426 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.164103 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.164212 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.164355 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.164355 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.164518 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.164610 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.164705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.164822 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.164918 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.165134 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.165235 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.165443 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.165546 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.165748 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.165840 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.166051 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.166143 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.166355 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.166456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.166657 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.166749 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.166983 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.167094 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.167290 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.167386 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.167594 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.167694 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.167896 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.167989 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.168198 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.168293 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.168500 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.168593 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.168811 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.168911 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.169121 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.169220 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.169445 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.169536 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.169767 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.169869 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.170076 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.170170 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.170384 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.170490 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.170696 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.170851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.171040 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.171208 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.171361 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.171535 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.171675 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.171988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.172205 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.172347 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.172538 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.172720 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.172947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.173111 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.173273 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.173422 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.173573 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.173754 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.173928 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.174081 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.174243 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.174396 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.174556 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.174723 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.174950 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.175105 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.175275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.175438 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.175589 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.175751 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.175917 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.176085 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.176234 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.176398 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.176548 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.176780 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.176950 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.177098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.177251 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.177402 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.177564 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.177731 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.177882 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.178099 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.178256 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.178419 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.178572 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.178739 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.178951 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.179627 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.179780 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.179780 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.180041 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.180041 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.180312 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.180683 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.180913 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.181063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.181220 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.181366 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.181519 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.181654 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.181790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.181935 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.182153 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.182305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.182460 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.182598 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.182691 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.182774 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.182860 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.182984 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.183067 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.183205 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.183302 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.183403 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.183490 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.183582 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.183663 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.183783 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.183890 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.184100 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.184185 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.184423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 07:48:41.188685 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.188898 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.189266 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.190115 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.190912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.191117 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.191466 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.191799 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.192335 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.192821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.193157 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.193498 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.193827 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.194195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.194742 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.195903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.196531 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.197134 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.197906 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.197906 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.198210 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.198573 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.198879 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.199227 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.199541 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.200003 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.200327 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.200989 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.201529 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.202027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.202357 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.202674 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.203019 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.203339 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.203657 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.203976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.204287 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.204611 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.204916 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.205232 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.205539 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.205854 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.206163 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.206505 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.206863 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.207191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.207522 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.207837 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.208166 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.208481 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.208807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.209135 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.209460 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.209776 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.210128 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.210492 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.210810 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.211150 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.211466 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.211784 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.212099 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.212434 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.212770 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.213082 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.213411 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.213732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.214053 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.214376 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.214692 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.215049 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.215366 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.215681 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.215995 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.216310 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.216625 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.216948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.217280 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.217582 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.217902 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.218221 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.218552 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.218902 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.219218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.219548 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.219881 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.220238 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.220555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.220901 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.221235 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.221551 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.221866 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.222175 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 07:48:41.222419 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 07:48:41.247694 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO dbcounter [None req-a6e98ec7-13f0-4a1c-8174-d88370914bc7 None None] Registered counter for database nova_api Jul 27 07:48:41.268157 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_db.sqlalchemy.engines [None req-a6e98ec7-13f0-4a1c-8174-d88370914bc7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 07:48:41.274663 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writer thread running {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 07:48:41.285498 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO dbcounter [None req-204f5298-f818-4b1f-92ec-09d3a8e67159 None None] Registered counter for database nova_api Jul 27 07:48:41.306707 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_db.sqlalchemy.engines [None req-204f5298-f818-4b1f-92ec-09d3a8e67159 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 07:48:41.313333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writer thread running {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 07:48:41.331245 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.context [None req-a6e98ec7-13f0-4a1c-8174-d88370914bc7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b(cell1) {{(pid=117780) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 07:48:41.335561 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a6e98ec7-13f0-4a1c-8174-d88370914bc7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:48:41.337138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a6e98ec7-13f0-4a1c-8174-d88370914bc7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:48:41.337952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a6e98ec7-13f0-4a1c-8174-d88370914bc7 None None] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:48:41.340265 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a6e98ec7-13f0-4a1c-8174-d88370914bc7 None None] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:48:41.342275 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO dbcounter [None req-a6e98ec7-13f0-4a1c-8174-d88370914bc7 None None] Registered counter for database nova_cell0 Jul 27 07:48:41.346417 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO dbcounter [None req-a6e98ec7-13f0-4a1c-8174-d88370914bc7 None None] Registered counter for database nova_cell1 Jul 27 07:48:41.354533 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_db.sqlalchemy.engines [None req-a6e98ec7-13f0-4a1c-8174-d88370914bc7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 07:48:41.356815 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_db.sqlalchemy.engines [None req-a6e98ec7-13f0-4a1c-8174-d88370914bc7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 07:48:41.362403 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writer thread running {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 07:48:41.364659 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writer thread running {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 07:48:41.369910 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.context [None req-204f5298-f818-4b1f-92ec-09d3a8e67159 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b(cell1) {{(pid=117779) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 07:48:41.374073 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-204f5298-f818-4b1f-92ec-09d3a8e67159 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:48:41.375697 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-204f5298-f818-4b1f-92ec-09d3a8e67159 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:48:41.376508 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-204f5298-f818-4b1f-92ec-09d3a8e67159 None None] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:48:41.378780 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-204f5298-f818-4b1f-92ec-09d3a8e67159 None None] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:48:41.380805 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO dbcounter [None req-204f5298-f818-4b1f-92ec-09d3a8e67159 None None] Registered counter for database nova_cell0 Jul 27 07:48:41.384967 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO dbcounter [None req-204f5298-f818-4b1f-92ec-09d3a8e67159 None None] Registered counter for database nova_cell1 Jul 27 07:48:41.392507 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_db.sqlalchemy.engines [None req-204f5298-f818-4b1f-92ec-09d3a8e67159 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 07:48:41.393898 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_db.sqlalchemy.engines [None req-204f5298-f818-4b1f-92ec-09d3a8e67159 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 07:48:41.401485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writer thread running {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 07:48:41.401823 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writer thread running {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 07:48:41.517660 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO dbcounter [None req-a6e98ec7-13f0-4a1c-8174-d88370914bc7 None None] Registered counter for database nova_cell0 Jul 27 07:48:41.525631 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_db.sqlalchemy.engines [None req-a6e98ec7-13f0-4a1c-8174-d88370914bc7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 07:48:41.531623 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writer thread running {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 07:48:41.564858 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO dbcounter [None req-204f5298-f818-4b1f-92ec-09d3a8e67159 None None] Registered counter for database nova_cell0 Jul 27 07:48:41.572807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_db.sqlalchemy.engines [None req-204f5298-f818-4b1f-92ec-09d3a8e67159 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 07:48:41.577388 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writer thread running {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 07:48:41.846688 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: WARNING keystonemiddleware.auth_token [None req-a6e98ec7-13f0-4a1c-8174-d88370914bc7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 07:48:41.854788 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: WARNING keystonemiddleware.auth_token [None req-a6e98ec7-13f0-4a1c-8174-d88370914bc7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 07:48:41.899152 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: WARNING keystonemiddleware.auth_token [None req-204f5298-f818-4b1f-92ec-09d3a8e67159 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 07:48:41.906472 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: WARNING keystonemiddleware.auth_token [None req-204f5298-f818-4b1f-92ec-09d3a8e67159 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 07:48:42.198261 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: WARNING keystonemiddleware.auth_token [None req-a6e98ec7-13f0-4a1c-8174-d88370914bc7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 07:48:42.204284 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: WARNING keystonemiddleware.auth_token [None req-a6e98ec7-13f0-4a1c-8174-d88370914bc7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 07:48:42.209790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556c2b6a99c0 pid: 117780 (default app) Jul 27 07:48:42.255452 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: WARNING keystonemiddleware.auth_token [None req-204f5298-f818-4b1f-92ec-09d3a8e67159 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 07:48:42.261761 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: WARNING keystonemiddleware.auth_token [None req-204f5298-f818-4b1f-92ec-09d3a8e67159 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 07:48:42.267177 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556c2b6a99c0 pid: 117779 (default app) Jul 27 07:49:27.692364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ca11b904-ae4a-4860-9741-6f2fb380914a tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] Calling method '.version_select at 0x7f1a0048a4c0>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:27.763708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:27.765062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:27.766229 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:27.767315 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:28.631752 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ca11b904-ae4a-4860-9741-6f2fb380914a tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/715f2c9d-461f-4db6-94a6-86dc1782a55e" status: 200 len: 351 microversion: 2.1 time: 1.314795 Jul 27 07:49:28.632779 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 1/1] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Jul 27 07:49:27 2022] GET /compute/v2.1/os-volumes/715f2c9d-461f-4db6-94a6-86dc1782a55e => generated 351 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:49:30.728536 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-24db1e8f-9fdb-42da-9921-e04a1b3115df tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] Calling method '.version_select at 0x7f1a0048c550>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:30.790789 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=3 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:30.791932 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=3 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:30.793488 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=3 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:30.794387 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=3 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:31.314135 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-24db1e8f-9fdb-42da-9921-e04a1b3115df tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/675bedec-0b0a-4f54-9abf-a2d90b43de98" status: 200 len: 351 microversion: 2.1 time: 0.894747 Jul 27 07:49:31.324211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 1/2] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Jul 27 07:49:30 2022] GET /compute/v2.1/os-volumes/675bedec-0b0a-4f54-9abf-a2d90b43de98 => generated 351 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:49:33.486062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-db4cdcd1-6488-4f7e-b5ac-327b59aa9ba0 tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] Calling method '.version_select at 0x7f1a002e4820>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:33.586381 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-db4cdcd1-6488-4f7e-b5ac-327b59aa9ba0 tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/9bff3fd4-db72-4371-939f-3eb8ce3666e0" status: 200 len: 350 microversion: 2.1 time: 0.104495 Jul 27 07:49:33.587381 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Jul 27 07:49:33 2022] GET /compute/v2.1/os-volumes/9bff3fd4-db72-4371-939f-3eb8ce3666e0 => generated 350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:49:33.608340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-fe739257-f73c-44fb-a29c-07fda38ca928 tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] Calling method '.version_select at 0x7f1a002e3700>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:33.831739 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-fe739257-f73c-44fb-a29c-07fda38ca928 tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.235257 Jul 27 07:49:33.832317 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1134 bytes} [Wed Jul 27 07:49:33 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:33.849820 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a592575b-cb74-429e-967a-60563bae23c8 tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] Calling method '.version_select at 0x7f1a002e48b0>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:34.006194 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a592575b-cb74-429e-967a-60563bae23c8 tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.161275 Jul 27 07:49:34.007364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 3/5] 10.222.0.18 () {58 vars in 1149 bytes} [Wed Jul 27 07:49:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:49:34.025287 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7c1687e4-876d-461c-8fdf-3901e8e3c238 tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] Calling method '.version_select at 0x7f1a002a53a0>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:34.219018 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7c1687e4-876d-461c-8fdf-3901e8e3c238 tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.202054 Jul 27 07:49:34.220062 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 3/6] 10.222.0.18 () {58 vars in 1134 bytes} [Wed Jul 27 07:49:34 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:34.233866 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-15067483-4f50-40c7-93e7-3cee7d23e10e tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] Calling method '.version_select at 0x7f1a002e4ee0>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:34.487558 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-15067483-4f50-40c7-93e7-3cee7d23e10e tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.257826 Jul 27 07:49:34.489692 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1167 bytes} [Wed Jul 27 07:49:34 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:49:34.503548 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-400a5b9d-a6f9-4096-a2ab-7d95368c5ef6 tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] Calling method '.version_select at 0x7f1a00240a60>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:34.816916 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-400a5b9d-a6f9-4096-a2ab-7d95368c5ef6 tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.317631 Jul 27 07:49:34.817934 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 5/8] 10.222.0.18 () {58 vars in 1170 bytes} [Wed Jul 27 07:49:34 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:49:34.840241 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-54efb244-94d8-4cca-b47f-75eec166817d tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] Calling method '.version_select at 0x7f1a00248ca0>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:35.172810 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-54efb244-94d8-4cca-b47f-75eec166817d tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.342322 Jul 27 07:49:35.174771 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 6/9] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Jul 27 07:49:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:35.190666 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a55cadc4-254f-48db-afec-c96232e3ca79 tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] Calling method '.version_select at 0x7f1a002489d0>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:35.231767 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-6e357083-e350-4893-a116-a48942ff1736 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Action: 'create', calling method: .version_select at 0x7f1a002a5820>, body: {"keypair": {"name": "tempest-keypair-238013743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHvH0ABaFmS9mPGMZvosXVere03apPlJGJVkZZ9FilRXCyiBznAaWItZdOD6YJZXXDMDfBVRs48Ulec4JY7G49fMl6UmFXdUL1OCXS9UuCZbxXWx1sgYJJUvAZQNh3mTg=="}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:49:35.391424 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-6e357083-e350-4893-a116-a48942ff1736 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Getting quotas for project 88e9fffbb5c6457ca3bc45c6226230a3. Resources: {'key_pairs'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:49:35.435652 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-6e357083-e350-4893-a116-a48942ff1736 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Getting quotas for user 7e3a5b392d9d44859110f048bea7331b and project 88e9fffbb5c6457ca3bc45c6226230a3. Resources: {'key_pairs'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:49:35.504936 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a55cadc4-254f-48db-afec-c96232e3ca79 tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.317990 Jul 27 07:49:35.506402 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 7/10] 10.222.0.18 () {58 vars in 1188 bytes} [Wed Jul 27 07:49:35 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:49:35.519145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e1a37202-3ea1-464f-8a64-92ae7ebeddbb tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] Calling method '.version_select at 0x7f1a0024c940>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:35.586587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-6e357083-e350-4893-a116-a48942ff1736 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.212491 Jul 27 07:49:35.587968 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 4/11] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Jul 27 07:49:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:49:35.806727 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e1a37202-3ea1-464f-8a64-92ae7ebeddbb tempest-VolumesTestJSON-1000147749 tempest-VolumesTestJSON-1000147749-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.291177 Jul 27 07:49:35.819171 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 8/12] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Jul 27 07:49:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:41.610788 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f2730f68-c938-4af0-b995-c79765b368df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1791823129", "imageRef": "646bfb5d-ef25-404a-a432-35d4209840fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:49:41.846556 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.network.neutron [None req-f2730f68-c938-4af0-b995-c79765b368df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] validate_networks() for [('cc6dfff5-7af6-4fd0-8eff-af097b6ee41a', None, None, None, None, None)] {{(pid=117779) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:49:44.738445 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-f2730f68-c938-4af0-b995-c79765b368df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Flavor limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:49:44.739089 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-f2730f68-c938-4af0-b995-c79765b368df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Image limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:49:44.740388 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-f2730f68-c938-4af0-b995-c79765b368df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Flavor pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:49:44.740818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-f2730f68-c938-4af0-b995-c79765b368df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Image pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:49:44.741248 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-f2730f68-c938-4af0-b995-c79765b368df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:49:44.764763 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f2730f68-c938-4af0-b995-c79765b368df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:44.773591 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f2730f68-c938-4af0-b995-c79765b368df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:44.776813 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f2730f68-c938-4af0-b995-c79765b368df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:44.777656 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f2730f68-c938-4af0-b995-c79765b368df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:44.868049 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-f2730f68-c938-4af0-b995-c79765b368df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Getting quotas for project c8e43fa41dc8445abed15accf9163b32. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:49:44.881279 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-f2730f68-c938-4af0-b995-c79765b368df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Getting quotas for user cb1cee30bc59446d882880d978b78bc2 and project c8e43fa41dc8445abed15accf9163b32. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:49:44.914567 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f2730f68-c938-4af0-b995-c79765b368df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Going to run 1 instances... {{(pid=117779) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:49:44.920972 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f2730f68-c938-4af0-b995-c79765b368df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='646bfb5d-ef25-404a-a432-35d4209840fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:49:45.163978 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f2730f68-c938-4af0-b995-c79765b368df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.132121 Jul 27 07:49:45.165280 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 5/13] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 07:49:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 4134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 07:49:45.173371 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c26dba89-821d-4401-bc5d-562734733e12 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1416608438", "imageRef": "646bfb5d-ef25-404a-a432-35d4209840fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9824a9e9-8b2a-4b9d-b805-9d8ca503fdb9"}], "security_groups": [{"name": "tempest-securitygroup--1936476743"}], "key_name": "tempest-keypair-238013743", "user_data": "}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:49:45.280047 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7de8c34a-22c2-4dab-bc4d-32d213a45ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-761645300", "imageRef": "646bfb5d-ef25-404a-a432-35d4209840fd", "flavorRef": "452", "networks": [{"uuid": "277035ce-6b47-438c-9251-8f0f985ce14c"}]}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:49:45.474163 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.network.neutron [None req-c26dba89-821d-4401-bc5d-562734733e12 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] validate_networks() for [('9824a9e9-8b2a-4b9d-b805-9d8ca503fdb9', None, None, None, None, None)] {{(pid=117779) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:49:45.584227 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.network.neutron [None req-7de8c34a-22c2-4dab-bc4d-32d213a45ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] validate_networks() for [('277035ce-6b47-438c-9251-8f0f985ce14c', None, None, None, None, None)] {{(pid=117780) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:49:46.479767 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-c26dba89-821d-4401-bc5d-562734733e12 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Flavor limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:49:46.484881 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-c26dba89-821d-4401-bc5d-562734733e12 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Image limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:49:46.485395 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-c26dba89-821d-4401-bc5d-562734733e12 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Flavor pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:49:46.485820 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-c26dba89-821d-4401-bc5d-562734733e12 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Image pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:49:46.486328 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-c26dba89-821d-4401-bc5d-562734733e12 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:49:46.509868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c26dba89-821d-4401-bc5d-562734733e12 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:46.510322 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c26dba89-821d-4401-bc5d-562734733e12 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:46.511971 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c26dba89-821d-4401-bc5d-562734733e12 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:46.512421 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c26dba89-821d-4401-bc5d-562734733e12 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:46.566624 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-c26dba89-821d-4401-bc5d-562734733e12 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Getting quotas for project 88e9fffbb5c6457ca3bc45c6226230a3. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:49:46.585689 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-c26dba89-821d-4401-bc5d-562734733e12 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Getting quotas for user 7e3a5b392d9d44859110f048bea7331b and project 88e9fffbb5c6457ca3bc45c6226230a3. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:49:46.636820 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c26dba89-821d-4401-bc5d-562734733e12 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Going to run 1 instances... {{(pid=117779) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:49:46.647303 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c26dba89-821d-4401-bc5d-562734733e12 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='646bfb5d-ef25-404a-a432-35d4209840fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:49:46.792107 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c26dba89-821d-4401-bc5d-562734733e12 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.622701 Jul 27 07:49:46.792823 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 6/14] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 07:49:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 07:49:46.816390 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d1ea0805-d200-4fb0-b0fb-ec6fea9559cc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:46.817041 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d1ea0805-d200-4fb0-b0fb-ec6fea9559cc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:49:47.108831 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d1ea0805-d200-4fb0-b0fb-ec6fea9559cc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:49:47.158645 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d1ea0805-d200-4fb0-b0fb-ec6fea9559cc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1222 microversion: 2.1 time: 0.356565 Jul 27 07:49:47.165108 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 7/15] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:49:46 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1222 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:47.189013 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b020f18e-ec3d-4ce1-b000-47867194ea79 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:47.199714 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b020f18e-ec3d-4ce1-b000-47867194ea79 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:49:47.451635 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b020f18e-ec3d-4ce1-b000-47867194ea79 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:49:47.464474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b020f18e-ec3d-4ce1-b000-47867194ea79 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1237 microversion: 2.1 time: 0.297904 Jul 27 07:49:47.468050 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:49:47 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1237 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:47.629033 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-dabe25bf-b338-4cb4-9a6f-ea7b134d2acd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2116355657", "imageRef": "646bfb5d-ef25-404a-a432-35d4209840fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:49:47.761416 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.network.neutron [None req-dabe25bf-b338-4cb4-9a6f-ea7b134d2acd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] validate_networks() for [('cc6dfff5-7af6-4fd0-8eff-af097b6ee41a', None, None, None, None, None)] {{(pid=117779) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:49:49.043699 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-dabe25bf-b338-4cb4-9a6f-ea7b134d2acd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Flavor limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:49:49.044272 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-dabe25bf-b338-4cb4-9a6f-ea7b134d2acd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Image limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:49:49.045151 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-dabe25bf-b338-4cb4-9a6f-ea7b134d2acd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Flavor pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:49:49.045575 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-dabe25bf-b338-4cb4-9a6f-ea7b134d2acd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Image pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:49:49.045994 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-dabe25bf-b338-4cb4-9a6f-ea7b134d2acd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:49:49.063357 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dabe25bf-b338-4cb4-9a6f-ea7b134d2acd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:49.066290 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dabe25bf-b338-4cb4-9a6f-ea7b134d2acd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:49.067454 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dabe25bf-b338-4cb4-9a6f-ea7b134d2acd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:49.070098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dabe25bf-b338-4cb4-9a6f-ea7b134d2acd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:49.125147 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-dabe25bf-b338-4cb4-9a6f-ea7b134d2acd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Getting quotas for project c8e43fa41dc8445abed15accf9163b32. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:49:49.137275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-dabe25bf-b338-4cb4-9a6f-ea7b134d2acd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Getting quotas for user cb1cee30bc59446d882880d978b78bc2 and project c8e43fa41dc8445abed15accf9163b32. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:49:49.170498 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-dabe25bf-b338-4cb4-9a6f-ea7b134d2acd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Going to run 1 instances... {{(pid=117779) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:49:49.174122 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-dabe25bf-b338-4cb4-9a6f-ea7b134d2acd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='646bfb5d-ef25-404a-a432-35d4209840fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:49:49.297281 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-dabe25bf-b338-4cb4-9a6f-ea7b134d2acd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.670481 Jul 27 07:49:49.304107 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 9/17] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 07:49:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 1675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 07:49:49.529856 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-7de8c34a-22c2-4dab-bc4d-32d213a45ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Flavor limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:49:49.530362 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-7de8c34a-22c2-4dab-bc4d-32d213a45ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Image limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:49:49.530762 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-7de8c34a-22c2-4dab-bc4d-32d213a45ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Flavor pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:49:49.531201 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-7de8c34a-22c2-4dab-bc4d-32d213a45ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Image pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:49:49.531616 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-7de8c34a-22c2-4dab-bc4d-32d213a45ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:49:49.596639 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7de8c34a-22c2-4dab-bc4d-32d213a45ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:49.597894 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7de8c34a-22c2-4dab-bc4d-32d213a45ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:49.605924 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7de8c34a-22c2-4dab-bc4d-32d213a45ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:49.607174 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7de8c34a-22c2-4dab-bc4d-32d213a45ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:49.680290 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-7de8c34a-22c2-4dab-bc4d-32d213a45ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Getting quotas for project 81e9270b6ae24d75b778de7e0ade50fc. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:49:49.701756 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-7de8c34a-22c2-4dab-bc4d-32d213a45ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Getting quotas for user be2d0a6b52c8465a8ae2f46d1270ae38 and project 81e9270b6ae24d75b778de7e0ade50fc. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:49:49.721797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7de8c34a-22c2-4dab-bc4d-32d213a45ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Going to run 1 instances... {{(pid=117780) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:49:49.737091 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7de8c34a-22c2-4dab-bc4d-32d213a45ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='646bfb5d-ef25-404a-a432-35d4209840fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:49:50.000252 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7de8c34a-22c2-4dab-bc4d-32d213a45ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.701415 Jul 27 07:49:50.001209 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 9/18] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 07:49:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 5703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 07:49:50.013846 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7fea4db1-cbf4-4956-9c13-271fa315eb88 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:50.014830 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7fea4db1-cbf4-4956-9c13-271fa315eb88 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:49:50.049767 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7fea4db1-cbf4-4956-9c13-271fa315eb88 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:50.050216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7fea4db1-cbf4-4956-9c13-271fa315eb88 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:50.073788 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7fea4db1-cbf4-4956-9c13-271fa315eb88 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:50.078284 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7fea4db1-cbf4-4956-9c13-271fa315eb88 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:50.270810 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a122182a-eb51-4f8f-a0c2-f71082201ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Action: 'create', calling method: .version_select at 0x7f19ff902790>, body: {"keypair": {"name": "tempest-keypair-1706139137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0n6J8dljKc+c0Ry++pIttD09hLq4p9udnj+rrglqJeEDlVc/NgOQXPrrsqjVQiGj2CuMJkTW9dLsS7DX5ItTgKqkEeU2EpuHdtn1U+sNBFMMPFkewI2mUWklPjPbIzHg=="}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:49:50.333960 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-a122182a-eb51-4f8f-a0c2-f71082201ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Getting quotas for project 690822c00bf34b2d90eee3e2026c78fb. Resources: {'key_pairs'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:49:50.360726 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-a122182a-eb51-4f8f-a0c2-f71082201ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Getting quotas for user eb3d3ca2457b47a29b7c94bd8be450cd and project 690822c00bf34b2d90eee3e2026c78fb. Resources: {'key_pairs'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:49:50.463557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a122182a-eb51-4f8f-a0c2-f71082201ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.162071 Jul 27 07:49:50.465430 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 10/19] 10.222.0.18 () {62 vars in 1200 bytes} [Wed Jul 27 07:49:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1166 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 27 07:49:50.476628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a202cbeb-6967-4343-9225-0beab0cd400a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:50.485715 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a202cbeb-6967-4343-9225-0beab0cd400a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:49:50.706526 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7fea4db1-cbf4-4956-9c13-271fa315eb88 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:49:50.750673 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7fea4db1-cbf4-4956-9c13-271fa315eb88 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1289 microversion: 2.1 time: 0.735333 Jul 27 07:49:50.751373 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 10/20] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:49:50 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1289 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:51.002727 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a202cbeb-6967-4343-9225-0beab0cd400a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:49:51.021897 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a202cbeb-6967-4343-9225-0beab0cd400a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1222 microversion: 2.1 time: 0.553469 Jul 27 07:49:51.041441 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 11/21] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:49:50 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1222 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:51.062802 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0cbe6edb-48a3-4dcf-b82b-d3492dbbf6d0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:51.070731 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0cbe6edb-48a3-4dcf-b82b-d3492dbbf6d0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:49:51.106683 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0cbe6edb-48a3-4dcf-b82b-d3492dbbf6d0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:51.107446 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0cbe6edb-48a3-4dcf-b82b-d3492dbbf6d0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:51.110480 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0cbe6edb-48a3-4dcf-b82b-d3492dbbf6d0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:51.110964 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0cbe6edb-48a3-4dcf-b82b-d3492dbbf6d0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:51.628053 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5e090826-7a4f-4c8e-be50-b7fabec85c59 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Action: 'create', calling method: .version_select at 0x7f19ff0dc1f0>, body: {"keypair": {"name": "tempest-keypair-353337677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeoVoWI8bVhIZEZg4hQ37J3EJ2VOacSSEULKrnI/orNzbLfqQniAGWmJOW2ALIjeVx0DAAin3q5X5R3nK/25/nH0RDXaNtGU3u6qK5y8KFz5Gg/jWHrHOrUP/wQWZ07ng=="}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:49:51.702362 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-5e090826-7a4f-4c8e-be50-b7fabec85c59 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Getting quotas for project 1cabcb825ebe4430a7ffa759d5e53d2f. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:49:51.721448 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-5e090826-7a4f-4c8e-be50-b7fabec85c59 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Getting quotas for user df8fb928aa42413b9d03e83f46dd48bc and project 1cabcb825ebe4430a7ffa759d5e53d2f. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:49:51.824220 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5e090826-7a4f-4c8e-be50-b7fabec85c59 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.068361 Jul 27 07:49:51.824853 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 11/22] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Jul 27 07:49:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:49:51.848042 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-abfd3687-3d0d-45ac-b7e3-30b910f4afbe tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:51.850493 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-abfd3687-3d0d-45ac-b7e3-30b910f4afbe tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:49:51.875683 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abfd3687-3d0d-45ac-b7e3-30b910f4afbe tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:51.876389 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abfd3687-3d0d-45ac-b7e3-30b910f4afbe tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:51.877917 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abfd3687-3d0d-45ac-b7e3-30b910f4afbe tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:51.878585 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abfd3687-3d0d-45ac-b7e3-30b910f4afbe tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:52.086059 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-abfd3687-3d0d-45ac-b7e3-30b910f4afbe tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:49:52.098156 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-abfd3687-3d0d-45ac-b7e3-30b910f4afbe tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1295 microversion: 2.1 time: 0.261260 Jul 27 07:49:52.104301 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:49:51 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1295 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:52.118654 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c9f57bdd-38ab-4db4-b20e-0726e3cefce2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:52.118654 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c9f57bdd-38ab-4db4-b20e-0726e3cefce2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:49:52.143371 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9f57bdd-38ab-4db4-b20e-0726e3cefce2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:52.144498 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9f57bdd-38ab-4db4-b20e-0726e3cefce2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:52.146237 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9f57bdd-38ab-4db4-b20e-0726e3cefce2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:52.146852 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9f57bdd-38ab-4db4-b20e-0726e3cefce2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:52.314669 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0cbe6edb-48a3-4dcf-b82b-d3492dbbf6d0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:49:52.340689 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0cbe6edb-48a3-4dcf-b82b-d3492dbbf6d0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1218 microversion: 2.1 time: 1.296298 Jul 27 07:49:52.341306 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 12/24] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:49:51 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1218 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:52.372908 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c9f57bdd-38ab-4db4-b20e-0726e3cefce2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:49:52.384367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c9f57bdd-38ab-4db4-b20e-0726e3cefce2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1280 microversion: 2.1 time: 0.277947 Jul 27 07:49:52.385316 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 13/25] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:49:52 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1280 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:53.139708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-54c707c1-1a4c-4598-8f36-67bc1366e7b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:53.142190 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-54c707c1-1a4c-4598-8f36-67bc1366e7b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:49:53.166071 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-54c707c1-1a4c-4598-8f36-67bc1366e7b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:53.166652 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-54c707c1-1a4c-4598-8f36-67bc1366e7b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:53.184397 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-54c707c1-1a4c-4598-8f36-67bc1366e7b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:53.189359 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-54c707c1-1a4c-4598-8f36-67bc1366e7b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:53.363467 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8e75b206-1f26-4aae-9e4f-aa05ff97fe06 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:53.364784 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8e75b206-1f26-4aae-9e4f-aa05ff97fe06 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:49:53.376981 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e75b206-1f26-4aae-9e4f-aa05ff97fe06 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:53.383578 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e75b206-1f26-4aae-9e4f-aa05ff97fe06 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:53.386567 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e75b206-1f26-4aae-9e4f-aa05ff97fe06 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:53.388145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e75b206-1f26-4aae-9e4f-aa05ff97fe06 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:53.615929 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8e75b206-1f26-4aae-9e4f-aa05ff97fe06 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:49:53.624391 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8e75b206-1f26-4aae-9e4f-aa05ff97fe06 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1272 microversion: 2.1 time: 0.265377 Jul 27 07:49:53.624994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 14/26] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:49:53 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1272 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:53.649458 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-dfbb27f8-81f3-4660-be38-df48ffcec9d8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:53.652310 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-dfbb27f8-81f3-4660-be38-df48ffcec9d8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:49:53.687995 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dfbb27f8-81f3-4660-be38-df48ffcec9d8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:53.689763 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dfbb27f8-81f3-4660-be38-df48ffcec9d8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:53.693966 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dfbb27f8-81f3-4660-be38-df48ffcec9d8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:53.694863 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dfbb27f8-81f3-4660-be38-df48ffcec9d8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:53.864487 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-54c707c1-1a4c-4598-8f36-67bc1366e7b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:49:53.882395 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-54c707c1-1a4c-4598-8f36-67bc1366e7b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1295 microversion: 2.1 time: 0.760206 Jul 27 07:49:53.883561 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 13/27] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:49:53 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1295 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:54.441346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-dfbb27f8-81f3-4660-be38-df48ffcec9d8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:49:54.452768 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-dfbb27f8-81f3-4660-be38-df48ffcec9d8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1280 microversion: 2.1 time: 0.817783 Jul 27 07:49:54.471148 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 15/28] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:49:53 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1280 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:54.656285 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-6e9013ce-4b5b-4b70-a954-fb0c10d5d76c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:54.657489 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-6e9013ce-4b5b-4b70-a954-fb0c10d5d76c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:49:54.669956 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6e9013ce-4b5b-4b70-a954-fb0c10d5d76c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:54.678525 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6e9013ce-4b5b-4b70-a954-fb0c10d5d76c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:54.682550 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6e9013ce-4b5b-4b70-a954-fb0c10d5d76c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:54.683857 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6e9013ce-4b5b-4b70-a954-fb0c10d5d76c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:54.906184 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-96df6b7c-0339-4bda-acec-ddc362e7e882 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:54.907324 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-96df6b7c-0339-4bda-acec-ddc362e7e882 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:49:54.937598 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-96df6b7c-0339-4bda-acec-ddc362e7e882 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:54.941128 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-96df6b7c-0339-4bda-acec-ddc362e7e882 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:54.945668 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-96df6b7c-0339-4bda-acec-ddc362e7e882 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:54.947646 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-96df6b7c-0339-4bda-acec-ddc362e7e882 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:55.303579 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-6e9013ce-4b5b-4b70-a954-fb0c10d5d76c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:49:55.318228 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-6e9013ce-4b5b-4b70-a954-fb0c10d5d76c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1272 microversion: 2.1 time: 0.665431 Jul 27 07:49:55.319113 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 14/29] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:49:54 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1272 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:55.480582 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-cc308b55-06f8-4bfa-acc0-ef1345b415fc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:55.481490 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-cc308b55-06f8-4bfa-acc0-ef1345b415fc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:49:55.489169 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cc308b55-06f8-4bfa-acc0-ef1345b415fc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:55.492957 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cc308b55-06f8-4bfa-acc0-ef1345b415fc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:55.509110 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cc308b55-06f8-4bfa-acc0-ef1345b415fc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:55.509860 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cc308b55-06f8-4bfa-acc0-ef1345b415fc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:55.836661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-cc308b55-06f8-4bfa-acc0-ef1345b415fc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:49:55.855976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-cc308b55-06f8-4bfa-acc0-ef1345b415fc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1280 microversion: 2.1 time: 0.380598 Jul 27 07:49:55.862827 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 15/30] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:49:55 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1280 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:49:55.905801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-96df6b7c-0339-4bda-acec-ddc362e7e882 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:49:55.940175 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-96df6b7c-0339-4bda-acec-ddc362e7e882 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1295 microversion: 2.1 time: 1.035039 Jul 27 07:49:55.944367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 16/31] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:49:54 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1295 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:49:56.356332 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0ea4f44c-7c3a-4f7a-abf9-943538919f32 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:56.358105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0ea4f44c-7c3a-4f7a-abf9-943538919f32 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:49:56.377126 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0ea4f44c-7c3a-4f7a-abf9-943538919f32 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:56.388502 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0ea4f44c-7c3a-4f7a-abf9-943538919f32 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:56.390123 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0ea4f44c-7c3a-4f7a-abf9-943538919f32 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:56.392520 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0ea4f44c-7c3a-4f7a-abf9-943538919f32 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:56.881093 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-67d9cba0-e0aa-4761-9823-40c5d4ae5f5d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:56.882120 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-67d9cba0-e0aa-4761-9823-40c5d4ae5f5d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:49:56.889210 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-67d9cba0-e0aa-4761-9823-40c5d4ae5f5d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:56.898265 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-67d9cba0-e0aa-4761-9823-40c5d4ae5f5d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:56.901830 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-67d9cba0-e0aa-4761-9823-40c5d4ae5f5d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:56.902459 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-67d9cba0-e0aa-4761-9823-40c5d4ae5f5d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:57.505307 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0ea4f44c-7c3a-4f7a-abf9-943538919f32 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:49:57.513155 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0ea4f44c-7c3a-4f7a-abf9-943538919f32 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1272 microversion: 2.1 time: 1.168517 Jul 27 07:49:57.513728 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 16/32] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:49:56 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1272 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:57.573558 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2dd1846e-b9f5-4d04-b929-1dd04e499a04 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:57.584260 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2dd1846e-b9f5-4d04-b929-1dd04e499a04 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:49:57.602845 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2dd1846e-b9f5-4d04-b929-1dd04e499a04 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:57.603628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2dd1846e-b9f5-4d04-b929-1dd04e499a04 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:57.604960 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2dd1846e-b9f5-4d04-b929-1dd04e499a04 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:57.618430 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2dd1846e-b9f5-4d04-b929-1dd04e499a04 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:57.968914 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-67d9cba0-e0aa-4761-9823-40c5d4ae5f5d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:49:57.995999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-67d9cba0-e0aa-4761-9823-40c5d4ae5f5d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1280 microversion: 2.1 time: 1.116292 Jul 27 07:49:57.997174 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 17/33] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:49:56 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1280 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:58.544824 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-57affec1-7fa5-4f91-9d51-4d1d83751be9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:58.545463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-57affec1-7fa5-4f91-9d51-4d1d83751be9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:49:58.553897 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-57affec1-7fa5-4f91-9d51-4d1d83751be9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:58.554352 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-57affec1-7fa5-4f91-9d51-4d1d83751be9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:58.555203 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-57affec1-7fa5-4f91-9d51-4d1d83751be9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:58.555647 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-57affec1-7fa5-4f91-9d51-4d1d83751be9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:58.863812 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-57affec1-7fa5-4f91-9d51-4d1d83751be9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:49:58.885357 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-57affec1-7fa5-4f91-9d51-4d1d83751be9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1272 microversion: 2.1 time: 0.344268 Jul 27 07:49:58.887766 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 18/34] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:49:58 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1272 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:59.026812 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-01e3713c-c842-4a71-ac91-30afdc278c3c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:59.028346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-01e3713c-c842-4a71-ac91-30afdc278c3c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:49:59.055494 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-01e3713c-c842-4a71-ac91-30afdc278c3c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:59.056394 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-01e3713c-c842-4a71-ac91-30afdc278c3c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:59.065268 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-01e3713c-c842-4a71-ac91-30afdc278c3c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:59.066002 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-01e3713c-c842-4a71-ac91-30afdc278c3c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:59.099462 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=6 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:59.125615 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2dd1846e-b9f5-4d04-b929-1dd04e499a04 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:49:59.159196 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2dd1846e-b9f5-4d04-b929-1dd04e499a04 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 1.598701 Jul 27 07:49:59.161365 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 17/35] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:49:57 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:59.352844 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-01e3713c-c842-4a71-ac91-30afdc278c3c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:49:59.361098 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-01e3713c-c842-4a71-ac91-30afdc278c3c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1280 microversion: 2.1 time: 0.338419 Jul 27 07:49:59.371203 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 19/36] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:49:59 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1280 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:49:59.913488 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-eae0e704-1f64-407b-b74d-03fe25cf1f82 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:49:59.914371 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-eae0e704-1f64-407b-b74d-03fe25cf1f82 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:49:59.939343 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:49:59.939343 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-eae0e704-1f64-407b-b74d-03fe25cf1f82 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:59.939343 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-eae0e704-1f64-407b-b74d-03fe25cf1f82 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:49:59.939343 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-eae0e704-1f64-407b-b74d-03fe25cf1f82 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:49:59.939610 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-eae0e704-1f64-407b-b74d-03fe25cf1f82 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:00.179639 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ec6781aa-d6a5-4ee4-b735-5f9316245883 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:00.180271 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ec6781aa-d6a5-4ee4-b735-5f9316245883 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:00.199615 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:00.219425 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ec6781aa-d6a5-4ee4-b735-5f9316245883 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:00.221205 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ec6781aa-d6a5-4ee4-b735-5f9316245883 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:00.222057 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ec6781aa-d6a5-4ee4-b735-5f9316245883 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:00.229763 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ec6781aa-d6a5-4ee4-b735-5f9316245883 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:00.525237 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-eae0e704-1f64-407b-b74d-03fe25cf1f82 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:00.550528 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-eae0e704-1f64-407b-b74d-03fe25cf1f82 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1272 microversion: 2.1 time: 0.637038 Jul 27 07:50:00.551035 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 18/37] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:49:59 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1272 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:00.562909 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-45a43546-b6b9-4da8-99ca-3521252ddab2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:00.564413 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-45a43546-b6b9-4da8-99ca-3521252ddab2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:00.587570 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-45a43546-b6b9-4da8-99ca-3521252ddab2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:00.589043 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-45a43546-b6b9-4da8-99ca-3521252ddab2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:00.592627 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-45a43546-b6b9-4da8-99ca-3521252ddab2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:00.595282 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-45a43546-b6b9-4da8-99ca-3521252ddab2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:01.011762 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=32 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:01.032217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-45a43546-b6b9-4da8-99ca-3521252ddab2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:01.052588 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-45a43546-b6b9-4da8-99ca-3521252ddab2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1280 microversion: 2.1 time: 0.493412 Jul 27 07:50:01.052588 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 19/38] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:00 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1280 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:01.074981 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d7f9a416-0f12-4e4b-ba01-4737aa4ec144 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-263593318", "imageRef": "646bfb5d-ef25-404a-a432-35d4209840fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1972cd38-3033-48aa-ada5-6e0fb660b5ac"}], "security_groups": [{"name": "tempest-securitygroup--2087734021"}], "key_name": "tempest-keypair-1706139137", "user_data": "}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:50:01.207123 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ec6781aa-d6a5-4ee4-b735-5f9316245883 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:01.231145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ec6781aa-d6a5-4ee4-b735-5f9316245883 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 1.042821 Jul 27 07:50:01.251261 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 20/39] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:00 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:01.269132 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c15a8c02-25f8-40f3-8138-0059866482f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1176444836", "imageRef": "646bfb5d-ef25-404a-a432-35d4209840fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2524cead-0094-4b3d-89eb-61da848d7e54"}], "security_groups": [{"name": "tempest-securitygroup--1304559757"}], "key_name": "tempest-keypair-353337677", "user_data": "}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:50:01.556036 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.network.neutron [None req-c15a8c02-25f8-40f3-8138-0059866482f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] validate_networks() for [('2524cead-0094-4b3d-89eb-61da848d7e54', None, None, None, None, None)] {{(pid=117780) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:50:01.748747 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=10 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:01.891127 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.network.neutron [None req-d7f9a416-0f12-4e4b-ba01-4737aa4ec144 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] validate_networks() for [('1972cd38-3033-48aa-ada5-6e0fb660b5ac', None, None, None, None, None)] {{(pid=117779) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:50:03.267872 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-c15a8c02-25f8-40f3-8138-0059866482f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Flavor limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:50:03.269244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-c15a8c02-25f8-40f3-8138-0059866482f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Image limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:50:03.270807 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-c15a8c02-25f8-40f3-8138-0059866482f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Flavor pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:50:03.271449 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-c15a8c02-25f8-40f3-8138-0059866482f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Image pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:50:03.273151 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-c15a8c02-25f8-40f3-8138-0059866482f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:50:03.302985 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c15a8c02-25f8-40f3-8138-0059866482f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:03.303532 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c15a8c02-25f8-40f3-8138-0059866482f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:03.304404 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c15a8c02-25f8-40f3-8138-0059866482f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:03.304871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c15a8c02-25f8-40f3-8138-0059866482f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:03.354946 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-c15a8c02-25f8-40f3-8138-0059866482f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Getting quotas for project 1cabcb825ebe4430a7ffa759d5e53d2f. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:50:03.372057 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-c15a8c02-25f8-40f3-8138-0059866482f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Getting quotas for user df8fb928aa42413b9d03e83f46dd48bc and project 1cabcb825ebe4430a7ffa759d5e53d2f. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:50:03.438560 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c15a8c02-25f8-40f3-8138-0059866482f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Going to run 1 instances... {{(pid=117780) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:50:03.455002 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c15a8c02-25f8-40f3-8138-0059866482f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='646bfb5d-ef25-404a-a432-35d4209840fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:50:03.653985 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c15a8c02-25f8-40f3-8138-0059866482f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.389882 Jul 27 07:50:03.661957 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 07:50:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 2398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 07:50:03.670633 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6016cb13-dc7a-464f-9dc2-cdbc16fe7ca8 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:03.672202 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6016cb13-dc7a-464f-9dc2-cdbc16fe7ca8 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:03.688066 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6016cb13-dc7a-464f-9dc2-cdbc16fe7ca8 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:03.689727 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6016cb13-dc7a-464f-9dc2-cdbc16fe7ca8 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:03.695878 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6016cb13-dc7a-464f-9dc2-cdbc16fe7ca8 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:03.697683 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6016cb13-dc7a-464f-9dc2-cdbc16fe7ca8 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:04.562272 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6016cb13-dc7a-464f-9dc2-cdbc16fe7ca8 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:04.571173 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6016cb13-dc7a-464f-9dc2-cdbc16fe7ca8 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.906991 Jul 27 07:50:04.610658 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 22/41] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:03 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:04.624343 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-50d9a903-5cc8-4411-80ea-43f15d883f2c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:04.625949 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-50d9a903-5cc8-4411-80ea-43f15d883f2c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:04.639147 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-50d9a903-5cc8-4411-80ea-43f15d883f2c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:04.641674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-50d9a903-5cc8-4411-80ea-43f15d883f2c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:04.646450 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-50d9a903-5cc8-4411-80ea-43f15d883f2c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:04.647411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-50d9a903-5cc8-4411-80ea-43f15d883f2c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:05.145870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-50d9a903-5cc8-4411-80ea-43f15d883f2c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:05.163533 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-50d9a903-5cc8-4411-80ea-43f15d883f2c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.543600 Jul 27 07:50:05.165107 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 23/42] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:04 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:05.180541 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e266a294-3820-4cd9-9374-f441d51f450b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:05.198765 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e266a294-3820-4cd9-9374-f441d51f450b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:05.219527 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e266a294-3820-4cd9-9374-f441d51f450b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:05.228322 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e266a294-3820-4cd9-9374-f441d51f450b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:05.230636 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e266a294-3820-4cd9-9374-f441d51f450b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:05.237036 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e266a294-3820-4cd9-9374-f441d51f450b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:05.695927 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e266a294-3820-4cd9-9374-f441d51f450b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:05.712217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e266a294-3820-4cd9-9374-f441d51f450b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.542562 Jul 27 07:50:05.715611 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 24/43] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:05 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:05.730876 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-546aa463-81e7-4861-8c87-88cfc5266d3c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:05.733754 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-546aa463-81e7-4861-8c87-88cfc5266d3c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:05.757913 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-546aa463-81e7-4861-8c87-88cfc5266d3c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:05.758649 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-546aa463-81e7-4861-8c87-88cfc5266d3c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:05.760362 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-546aa463-81e7-4861-8c87-88cfc5266d3c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:05.761042 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-546aa463-81e7-4861-8c87-88cfc5266d3c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:05.927132 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-546aa463-81e7-4861-8c87-88cfc5266d3c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:05.943726 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-546aa463-81e7-4861-8c87-88cfc5266d3c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1293 microversion: 2.1 time: 0.225251 Jul 27 07:50:05.968346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 25/44] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:05 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1293 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:06.549926 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-b06be3ac-7104-4ed7-b4c5-8c76658045c8 req-f56c20c6-5b0c-4948-92d0-e6c84c9b6767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d14cae7-2ec9-4ab1-94c5-b63982ffc251", "tag": "f7533591-85c2-41a4-9ada-d6c9eebf0053"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:50:06.593402 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-b06be3ac-7104-4ed7-b4c5-8c76658045c8 req-f56c20c6-5b0c-4948-92d0-e6c84c9b6767 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:06.597694 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-b06be3ac-7104-4ed7-b4c5-8c76658045c8 req-f56c20c6-5b0c-4948-92d0-e6c84c9b6767 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:06.662162 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-b06be3ac-7104-4ed7-b4c5-8c76658045c8 req-f56c20c6-5b0c-4948-92d0-e6c84c9b6767 service nova] Creating event network-changed:f7533591-85c2-41a4-9ada-d6c9eebf0053 for instance 0d14cae7-2ec9-4ab1-94c5-b63982ffc251 on hv-cinder-82549 Jul 27 07:50:06.663140 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-b06be3ac-7104-4ed7-b4c5-8c76658045c8 req-f56c20c6-5b0c-4948-92d0-e6c84c9b6767 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 27 07:50:06.664513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2368fec2-f137-4ec0-8fda-47e45483b0e2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:06.665290 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2368fec2-f137-4ec0-8fda-47e45483b0e2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:06.666093 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2368fec2-f137-4ec0-8fda-47e45483b0e2 None None] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:06.666540 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2368fec2-f137-4ec0-8fda-47e45483b0e2 None None] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:06.676089 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.compute.rpcapi [None req-2368fec2-f137-4ec0-8fda-47e45483b0e2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 27 07:50:06.677237 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2368fec2-f137-4ec0-8fda-47e45483b0e2 None None] Releasing lock "compute-rpcapi-router" {{(pid=117780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 27 07:50:06.712733 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2368fec2-f137-4ec0-8fda-47e45483b0e2 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.742212 Jul 27 07:50:06.715037 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 26/45] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:50:06.721214 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b88f23fc-7799-4531-b182-03337a297c68 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:06.724689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b88f23fc-7799-4531-b182-03337a297c68 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:06.739377 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b88f23fc-7799-4531-b182-03337a297c68 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:06.741623 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b88f23fc-7799-4531-b182-03337a297c68 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:06.742588 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b88f23fc-7799-4531-b182-03337a297c68 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:06.747646 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b88f23fc-7799-4531-b182-03337a297c68 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:07.145593 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-d7f9a416-0f12-4e4b-ba01-4737aa4ec144 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Flavor limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:50:07.146277 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-d7f9a416-0f12-4e4b-ba01-4737aa4ec144 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Image limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:50:07.146962 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-d7f9a416-0f12-4e4b-ba01-4737aa4ec144 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Flavor pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:50:07.147534 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-d7f9a416-0f12-4e4b-ba01-4737aa4ec144 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Image pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:50:07.148097 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-d7f9a416-0f12-4e4b-ba01-4737aa4ec144 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:50:07.165337 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d7f9a416-0f12-4e4b-ba01-4737aa4ec144 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:07.172060 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d7f9a416-0f12-4e4b-ba01-4737aa4ec144 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:07.173108 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d7f9a416-0f12-4e4b-ba01-4737aa4ec144 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:07.173918 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d7f9a416-0f12-4e4b-ba01-4737aa4ec144 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:07.198879 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-d7f9a416-0f12-4e4b-ba01-4737aa4ec144 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Getting quotas for project 690822c00bf34b2d90eee3e2026c78fb. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:50:07.203822 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-d7f9a416-0f12-4e4b-ba01-4737aa4ec144 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Getting quotas for user eb3d3ca2457b47a29b7c94bd8be450cd and project 690822c00bf34b2d90eee3e2026c78fb. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:50:07.216558 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d7f9a416-0f12-4e4b-ba01-4737aa4ec144 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Going to run 1 instances... {{(pid=117779) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:50:07.219110 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d7f9a416-0f12-4e4b-ba01-4737aa4ec144 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='646bfb5d-ef25-404a-a432-35d4209840fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:50:07.250577 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b88f23fc-7799-4531-b182-03337a297c68 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:07.277689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b88f23fc-7799-4531-b182-03337a297c68 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.558798 Jul 27 07:50:07.280512 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 27/46] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:06 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:07.296606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d7f9a416-0f12-4e4b-ba01-4737aa4ec144 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 6.243392 Jul 27 07:50:07.297272 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 20/47] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Jul 27 07:50:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 6246 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 27 07:50:07.298895 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-49919909-dac0-4679-b67b-a419a487dedf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:07.299535 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-49919909-dac0-4679-b67b-a419a487dedf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:07.311517 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-33cd0814-c7ef-41be-9e89-4d0e9da36538 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:07.312168 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-33cd0814-c7ef-41be-9e89-4d0e9da36538 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:07.313295 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-49919909-dac0-4679-b67b-a419a487dedf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:07.314029 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-49919909-dac0-4679-b67b-a419a487dedf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:07.317883 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-49919909-dac0-4679-b67b-a419a487dedf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:07.319617 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-49919909-dac0-4679-b67b-a419a487dedf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:07.323644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-33cd0814-c7ef-41be-9e89-4d0e9da36538 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:07.324209 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-33cd0814-c7ef-41be-9e89-4d0e9da36538 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:07.327179 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-33cd0814-c7ef-41be-9e89-4d0e9da36538 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:07.327829 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-33cd0814-c7ef-41be-9e89-4d0e9da36538 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:07.367438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:07.783358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-49919909-dac0-4679-b67b-a419a487dedf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:07.806990 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-49919909-dac0-4679-b67b-a419a487dedf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.512560 Jul 27 07:50:07.806990 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 28/48] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:07 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:07.806990 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-88c57877-cd65-4d2f-8dea-8d05d0ab8213 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:07.806990 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-88c57877-cd65-4d2f-8dea-8d05d0ab8213 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:07.824968 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-88c57877-cd65-4d2f-8dea-8d05d0ab8213 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:07.825445 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-88c57877-cd65-4d2f-8dea-8d05d0ab8213 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:07.826257 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-88c57877-cd65-4d2f-8dea-8d05d0ab8213 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:07.826710 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-88c57877-cd65-4d2f-8dea-8d05d0ab8213 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:07.927931 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-88c57877-cd65-4d2f-8dea-8d05d0ab8213 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:07.938628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-88c57877-cd65-4d2f-8dea-8d05d0ab8213 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1301 microversion: 2.1 time: 0.141857 Jul 27 07:50:07.959071 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 29/49] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:07 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1301 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:07.966419 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3b820897-6d4c-4618-b219-25b4daadd0df tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:07.968084 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3b820897-6d4c-4618-b219-25b4daadd0df tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:07.987101 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-33cd0814-c7ef-41be-9e89-4d0e9da36538 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:07.999200 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-33cd0814-c7ef-41be-9e89-4d0e9da36538 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.699827 Jul 27 07:50:08.017168 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 21/50] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:07 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:08.156432 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3b820897-6d4c-4618-b219-25b4daadd0df tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:08.181597 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3b820897-6d4c-4618-b219-25b4daadd0df tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:08.187190 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3b820897-6d4c-4618-b219-25b4daadd0df tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:08.192307 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3b820897-6d4c-4618-b219-25b4daadd0df tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1281 microversion: 2.20 time: 0.229656 Jul 27 07:50:08.209198 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 30/51] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:07 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1281 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:08.304251 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0d761b3c-aaf9-45ea-b879-e0ac8380dc3c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:08.305840 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0d761b3c-aaf9-45ea-b879-e0ac8380dc3c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:08.317789 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0d761b3c-aaf9-45ea-b879-e0ac8380dc3c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:08.318485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0d761b3c-aaf9-45ea-b879-e0ac8380dc3c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:08.319667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0d761b3c-aaf9-45ea-b879-e0ac8380dc3c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:08.320360 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0d761b3c-aaf9-45ea-b879-e0ac8380dc3c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:08.820622 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b10d4ac5-b1f7-4328-9296-a66f247e9ab0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:08.821187 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b10d4ac5-b1f7-4328-9296-a66f247e9ab0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:08.836780 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b10d4ac5-b1f7-4328-9296-a66f247e9ab0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:08.837587 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b10d4ac5-b1f7-4328-9296-a66f247e9ab0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:08.839072 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b10d4ac5-b1f7-4328-9296-a66f247e9ab0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:08.839773 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b10d4ac5-b1f7-4328-9296-a66f247e9ab0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:09.037894 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b10d4ac5-b1f7-4328-9296-a66f247e9ab0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:09.045908 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b10d4ac5-b1f7-4328-9296-a66f247e9ab0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.230184 Jul 27 07:50:09.046564 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 31/52] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:08 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:09.065426 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b9cffb31-b755-49f7-b78e-0ac3dad09623 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:09.066108 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b9cffb31-b755-49f7-b78e-0ac3dad09623 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:09.073002 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b9cffb31-b755-49f7-b78e-0ac3dad09623 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:09.073574 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b9cffb31-b755-49f7-b78e-0ac3dad09623 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:09.074544 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b9cffb31-b755-49f7-b78e-0ac3dad09623 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:09.075169 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b9cffb31-b755-49f7-b78e-0ac3dad09623 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:09.149708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b9cffb31-b755-49f7-b78e-0ac3dad09623 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:09.157526 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b9cffb31-b755-49f7-b78e-0ac3dad09623 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1299 microversion: 2.1 time: 0.097006 Jul 27 07:50:09.158207 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 32/53] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:09 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:09.163393 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-8ce8dbf3-d44e-4120-8a9c-0a4575c97979 req-36ff2a3a-503a-4a7b-ae89-b2d75bbcd80e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480abe1b-7355-48b3-928a-4b32cc678979", "tag": "25e0ce5d-89f2-4b0c-92d3-258760019eca"}, {"name": "network-changed", "server_uuid": "41f7e2e6-f10c-45e8-aacb-67a155d5da44", "tag": "37d19150-619f-49f8-903f-5e239b14816f"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:50:09.174430 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-8ce8dbf3-d44e-4120-8a9c-0a4575c97979 req-36ff2a3a-503a-4a7b-ae89-b2d75bbcd80e service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:09.175051 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-8ce8dbf3-d44e-4120-8a9c-0a4575c97979 req-36ff2a3a-503a-4a7b-ae89-b2d75bbcd80e service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:09.190182 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-8ce8dbf3-d44e-4120-8a9c-0a4575c97979 req-36ff2a3a-503a-4a7b-ae89-b2d75bbcd80e service nova] Creating event network-changed:25e0ce5d-89f2-4b0c-92d3-258760019eca for instance 480abe1b-7355-48b3-928a-4b32cc678979 on hv-cinder-82549 Jul 27 07:50:09.190843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-8ce8dbf3-d44e-4120-8a9c-0a4575c97979 req-36ff2a3a-503a-4a7b-ae89-b2d75bbcd80e service nova] Creating event network-changed:37d19150-619f-49f8-903f-5e239b14816f for instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 on hv-cinder-82549 Jul 27 07:50:09.199207 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-8ce8dbf3-d44e-4120-8a9c-0a4575c97979 req-36ff2a3a-503a-4a7b-ae89-b2d75bbcd80e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039524 Jul 27 07:50:09.200357 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 33/54] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:50:09.206085 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-69158554-c1f3-4374-9c9d-d230d2a9f820 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:09.207705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-69158554-c1f3-4374-9c9d-d230d2a9f820 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:09.214956 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-69158554-c1f3-4374-9c9d-d230d2a9f820 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:09.215772 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-69158554-c1f3-4374-9c9d-d230d2a9f820 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:09.217698 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-69158554-c1f3-4374-9c9d-d230d2a9f820 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:09.219796 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-69158554-c1f3-4374-9c9d-d230d2a9f820 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:09.347975 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0d761b3c-aaf9-45ea-b879-e0ac8380dc3c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:09.361914 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0d761b3c-aaf9-45ea-b879-e0ac8380dc3c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 1.064123 Jul 27 07:50:09.370919 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 22/55] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:08 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:09.370919 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-8d08fb09-c19f-4990-9c20-d393d637c5ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:09.370919 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-8d08fb09-c19f-4990-9c20-d393d637c5ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:09.380712 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8d08fb09-c19f-4990-9c20-d393d637c5ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:09.381286 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8d08fb09-c19f-4990-9c20-d393d637c5ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:09.382160 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8d08fb09-c19f-4990-9c20-d393d637c5ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:09.382688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8d08fb09-c19f-4990-9c20-d393d637c5ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:09.412503 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-69158554-c1f3-4374-9c9d-d230d2a9f820 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:09.420802 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-69158554-c1f3-4374-9c9d-d230d2a9f820 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.219089 Jul 27 07:50:09.421392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 34/56] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:09 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:09.594337 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8d08fb09-c19f-4990-9c20-d393d637c5ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:09.609258 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8d08fb09-c19f-4990-9c20-d393d637c5ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:09.612142 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8d08fb09-c19f-4990-9c20-d393d637c5ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:09.615166 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-8d08fb09-c19f-4990-9c20-d393d637c5ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1333 microversion: 2.20 time: 0.250880 Jul 27 07:50:09.618115 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 23/57] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:09 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1333 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:10.076035 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8ea1f1c7-bb61-4878-87db-ed764a328c7b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:10.076642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8ea1f1c7-bb61-4878-87db-ed764a328c7b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:10.083943 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8ea1f1c7-bb61-4878-87db-ed764a328c7b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:10.084385 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8ea1f1c7-bb61-4878-87db-ed764a328c7b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:10.085185 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8ea1f1c7-bb61-4878-87db-ed764a328c7b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:10.085619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8ea1f1c7-bb61-4878-87db-ed764a328c7b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:10.186663 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7684a3af-5161-48fd-9486-32af3a878536 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:10.187545 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-7684a3af-5161-48fd-9486-32af3a878536 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:10.198750 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7684a3af-5161-48fd-9486-32af3a878536 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:10.201088 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7684a3af-5161-48fd-9486-32af3a878536 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:10.207716 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7684a3af-5161-48fd-9486-32af3a878536 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:10.208463 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7684a3af-5161-48fd-9486-32af3a878536 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:10.314492 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7684a3af-5161-48fd-9486-32af3a878536 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:10.326956 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7684a3af-5161-48fd-9486-32af3a878536 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1299 microversion: 2.1 time: 0.144112 Jul 27 07:50:10.329155 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 24/58] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:10 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1299 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:10.332752 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8ea1f1c7-bb61-4878-87db-ed764a328c7b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:10.340717 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8ea1f1c7-bb61-4878-87db-ed764a328c7b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.268617 Jul 27 07:50:10.355945 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 35/59] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:10 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:10.383422 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e4bf208e-12ff-4acc-9d17-d41eeb949d1a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:10.384840 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e4bf208e-12ff-4acc-9d17-d41eeb949d1a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:10.391741 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e4bf208e-12ff-4acc-9d17-d41eeb949d1a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:10.392496 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e4bf208e-12ff-4acc-9d17-d41eeb949d1a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:10.393379 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e4bf208e-12ff-4acc-9d17-d41eeb949d1a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:10.393965 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e4bf208e-12ff-4acc-9d17-d41eeb949d1a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:10.443792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-cb7bf6a7-0f6e-44bc-ae35-19305943b3be tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:10.444635 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-cb7bf6a7-0f6e-44bc-ae35-19305943b3be tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:10.453297 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cb7bf6a7-0f6e-44bc-ae35-19305943b3be tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:10.453760 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cb7bf6a7-0f6e-44bc-ae35-19305943b3be tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:10.454546 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cb7bf6a7-0f6e-44bc-ae35-19305943b3be tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:10.455015 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cb7bf6a7-0f6e-44bc-ae35-19305943b3be tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:10.610250 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e4bf208e-12ff-4acc-9d17-d41eeb949d1a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:10.619503 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e4bf208e-12ff-4acc-9d17-d41eeb949d1a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.240320 Jul 27 07:50:10.621545 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 25/60] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:10 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:10.669809 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-df2075c8-7a47-487b-b784-8782a1c0717e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:10.673131 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-df2075c8-7a47-487b-b784-8782a1c0717e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:10.686662 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-df2075c8-7a47-487b-b784-8782a1c0717e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:10.688068 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-df2075c8-7a47-487b-b784-8782a1c0717e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:10.689694 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-df2075c8-7a47-487b-b784-8782a1c0717e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:10.691069 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-df2075c8-7a47-487b-b784-8782a1c0717e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:10.826623 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-cb7bf6a7-0f6e-44bc-ae35-19305943b3be tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:10.846278 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-cb7bf6a7-0f6e-44bc-ae35-19305943b3be tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.407383 Jul 27 07:50:10.892514 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-df2075c8-7a47-487b-b784-8782a1c0717e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:10.896333 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 36/61] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:10 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:10.933852 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-df2075c8-7a47-487b-b784-8782a1c0717e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:10.938626 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-df2075c8-7a47-487b-b784-8782a1c0717e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:10.943068 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-df2075c8-7a47-487b-b784-8782a1c0717e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1339 microversion: 2.20 time: 0.289012 Jul 27 07:50:10.944617 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 26/62] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:10 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1339 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:11.233845 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-987785fa-dbab-4a8e-a413-f402786d5d45 req-1a82e6ec-0055-431f-ba55-3bdb8a5ceb62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "257c6f7b-d45d-499a-ade2-0b3371d09360", "tag": "f9450ccc-33c3-4bb9-9fe8-897c11b4d17a"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:50:11.247305 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:11.255767 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-987785fa-dbab-4a8e-a413-f402786d5d45 req-1a82e6ec-0055-431f-ba55-3bdb8a5ceb62 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:11.256673 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-987785fa-dbab-4a8e-a413-f402786d5d45 req-1a82e6ec-0055-431f-ba55-3bdb8a5ceb62 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:11.273141 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-987785fa-dbab-4a8e-a413-f402786d5d45 req-1a82e6ec-0055-431f-ba55-3bdb8a5ceb62 service nova] Creating event network-changed:f9450ccc-33c3-4bb9-9fe8-897c11b4d17a for instance 257c6f7b-d45d-499a-ade2-0b3371d09360 on hv-cinder-82549 Jul 27 07:50:11.284869 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-987785fa-dbab-4a8e-a413-f402786d5d45 req-1a82e6ec-0055-431f-ba55-3bdb8a5ceb62 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056000 Jul 27 07:50:11.285540 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 37/63] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:50:11.352997 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-8c076ced-f4a5-4245-97e4-5cfb1a23d1c2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:11.353720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-8c076ced-f4a5-4245-97e4-5cfb1a23d1c2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:11.360545 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8c076ced-f4a5-4245-97e4-5cfb1a23d1c2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:11.361358 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8c076ced-f4a5-4245-97e4-5cfb1a23d1c2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:11.362381 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8c076ced-f4a5-4245-97e4-5cfb1a23d1c2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:11.362986 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8c076ced-f4a5-4245-97e4-5cfb1a23d1c2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:11.364323 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c0d1dfea-b122-4dab-9e22-26d83fc15fb5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:11.365184 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c0d1dfea-b122-4dab-9e22-26d83fc15fb5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:11.368077 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=93 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:11.372055 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c0d1dfea-b122-4dab-9e22-26d83fc15fb5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:11.372676 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c0d1dfea-b122-4dab-9e22-26d83fc15fb5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:11.373994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c0d1dfea-b122-4dab-9e22-26d83fc15fb5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:11.374715 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c0d1dfea-b122-4dab-9e22-26d83fc15fb5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:11.529542 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8c076ced-f4a5-4245-97e4-5cfb1a23d1c2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:11.542663 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-8c076ced-f4a5-4245-97e4-5cfb1a23d1c2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.191016 Jul 27 07:50:11.543648 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 27/64] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:11 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:11.554486 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c0d1dfea-b122-4dab-9e22-26d83fc15fb5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:11.564121 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c0d1dfea-b122-4dab-9e22-26d83fc15fb5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.205390 Jul 27 07:50:11.564781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 38/65] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:11 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:11.646993 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9c0242ca-ec56-4974-b8ce-8e63434b8467 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:11.648015 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-9c0242ca-ec56-4974-b8ce-8e63434b8467 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:11.657122 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9c0242ca-ec56-4974-b8ce-8e63434b8467 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:11.658737 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9c0242ca-ec56-4974-b8ce-8e63434b8467 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:11.659486 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9c0242ca-ec56-4974-b8ce-8e63434b8467 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:11.661604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9c0242ca-ec56-4974-b8ce-8e63434b8467 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:11.824418 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9c0242ca-ec56-4974-b8ce-8e63434b8467 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:11.836595 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9c0242ca-ec56-4974-b8ce-8e63434b8467 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.195015 Jul 27 07:50:11.850917 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 28/66] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:11 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:11.889610 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-87c3bdc8-e33d-4a6a-ad56-aa9be2778cda tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:11.890642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-87c3bdc8-e33d-4a6a-ad56-aa9be2778cda tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:11.897881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-87c3bdc8-e33d-4a6a-ad56-aa9be2778cda tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:11.898245 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-87c3bdc8-e33d-4a6a-ad56-aa9be2778cda tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:11.899076 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-87c3bdc8-e33d-4a6a-ad56-aa9be2778cda tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:11.899652 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-87c3bdc8-e33d-4a6a-ad56-aa9be2778cda tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:11.976554 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a661a3c9-0318-4d4c-9bd7-26244cd550b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:11.977168 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a661a3c9-0318-4d4c-9bd7-26244cd550b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:11.991309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a661a3c9-0318-4d4c-9bd7-26244cd550b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:11.991948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a661a3c9-0318-4d4c-9bd7-26244cd550b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:11.992955 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a661a3c9-0318-4d4c-9bd7-26244cd550b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:11.993587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a661a3c9-0318-4d4c-9bd7-26244cd550b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:12.052234 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-87c3bdc8-e33d-4a6a-ad56-aa9be2778cda tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:12.061071 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-87c3bdc8-e33d-4a6a-ad56-aa9be2778cda tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.176469 Jul 27 07:50:12.062926 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 39/67] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:11 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:12.088237 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a661a3c9-0318-4d4c-9bd7-26244cd550b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:12.097380 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a661a3c9-0318-4d4c-9bd7-26244cd550b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:12.100695 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a661a3c9-0318-4d4c-9bd7-26244cd550b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:12.102139 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a661a3c9-0318-4d4c-9bd7-26244cd550b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1339 microversion: 2.20 time: 0.130986 Jul 27 07:50:12.102707 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 29/68] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:11 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1339 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:12.564599 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-dcab1973-6d4f-464b-ad97-a222eefa67d6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:12.565432 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-dcab1973-6d4f-464b-ad97-a222eefa67d6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:12.576219 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dcab1973-6d4f-464b-ad97-a222eefa67d6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:12.576631 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dcab1973-6d4f-464b-ad97-a222eefa67d6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:12.578177 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dcab1973-6d4f-464b-ad97-a222eefa67d6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:12.580524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dcab1973-6d4f-464b-ad97-a222eefa67d6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:12.586364 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2e313528-ba58-4d35-86b4-2494c1f04798 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:12.587012 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2e313528-ba58-4d35-86b4-2494c1f04798 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:12.594261 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2e313528-ba58-4d35-86b4-2494c1f04798 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:12.595895 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2e313528-ba58-4d35-86b4-2494c1f04798 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:12.597392 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2e313528-ba58-4d35-86b4-2494c1f04798 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:12.598328 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2e313528-ba58-4d35-86b4-2494c1f04798 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:12.737101 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-dcab1973-6d4f-464b-ad97-a222eefa67d6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:12.747791 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-dcab1973-6d4f-464b-ad97-a222eefa67d6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.186922 Jul 27 07:50:12.750999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 40/69] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:12 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:12.831476 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2e313528-ba58-4d35-86b4-2494c1f04798 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:12.844899 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2e313528-ba58-4d35-86b4-2494c1f04798 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.262134 Jul 27 07:50:12.847128 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 30/70] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:12 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:12.867234 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-02460b5f-6c82-4de1-bd19-50063e83f7ea tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:12.867871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-02460b5f-6c82-4de1-bd19-50063e83f7ea tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:12.877069 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-02460b5f-6c82-4de1-bd19-50063e83f7ea tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:12.877527 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-02460b5f-6c82-4de1-bd19-50063e83f7ea tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:12.878482 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-02460b5f-6c82-4de1-bd19-50063e83f7ea tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:12.879548 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-02460b5f-6c82-4de1-bd19-50063e83f7ea tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:13.091502 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-67f39878-5c64-45b6-a77d-ffcdd0433623 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:13.092197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-67f39878-5c64-45b6-a77d-ffcdd0433623 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:13.102912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-67f39878-5c64-45b6-a77d-ffcdd0433623 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:13.103373 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-67f39878-5c64-45b6-a77d-ffcdd0433623 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:13.110901 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-67f39878-5c64-45b6-a77d-ffcdd0433623 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:13.111626 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-67f39878-5c64-45b6-a77d-ffcdd0433623 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:13.135727 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-02460b5f-6c82-4de1-bd19-50063e83f7ea tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:13.161933 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-02460b5f-6c82-4de1-bd19-50063e83f7ea tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.297231 Jul 27 07:50:13.163216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 41/71] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:12 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:13.173534 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-782ad67d-18d1-4353-8075-19460369031e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:13.177206 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-782ad67d-18d1-4353-8075-19460369031e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:13.197687 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-782ad67d-18d1-4353-8075-19460369031e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:13.198264 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-782ad67d-18d1-4353-8075-19460369031e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:13.199306 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-782ad67d-18d1-4353-8075-19460369031e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:13.199841 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-782ad67d-18d1-4353-8075-19460369031e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:13.383650 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-67f39878-5c64-45b6-a77d-ffcdd0433623 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:13.384343 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-782ad67d-18d1-4353-8075-19460369031e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:13.393775 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-67f39878-5c64-45b6-a77d-ffcdd0433623 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.313393 Jul 27 07:50:13.395471 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 31/72] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:13 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:13.404602 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-782ad67d-18d1-4353-8075-19460369031e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:13.408062 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-6689b0de-54a4-48d7-a394-d5eec572cd80 req-c6948629-7de6-4742-afdf-03a15717bbee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6", "tag": "049be348-8604-49d4-9257-b55b2d5b98fd"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:50:13.409127 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-782ad67d-18d1-4353-8075-19460369031e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:13.410303 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-782ad67d-18d1-4353-8075-19460369031e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1339 microversion: 2.20 time: 0.245697 Jul 27 07:50:13.424594 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 42/73] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:13 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1339 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:13.435097 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-6689b0de-54a4-48d7-a394-d5eec572cd80 req-c6948629-7de6-4742-afdf-03a15717bbee service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:13.435554 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-6689b0de-54a4-48d7-a394-d5eec572cd80 req-c6948629-7de6-4742-afdf-03a15717bbee service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:13.459472 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-6689b0de-54a4-48d7-a394-d5eec572cd80 req-c6948629-7de6-4742-afdf-03a15717bbee service nova] Creating event network-changed:049be348-8604-49d4-9257-b55b2d5b98fd for instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 on hv-cinder-82549 Jul 27 07:50:13.460258 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-6689b0de-54a4-48d7-a394-d5eec572cd80 req-c6948629-7de6-4742-afdf-03a15717bbee service nova] Acquired lock "compute-rpcapi-router" {{(pid=117779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 27 07:50:13.461824 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-544f472f-1657-4931-abca-190fcc8ded85 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:13.462450 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-544f472f-1657-4931-abca-190fcc8ded85 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:13.463641 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-544f472f-1657-4931-abca-190fcc8ded85 None None] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:13.464227 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-544f472f-1657-4931-abca-190fcc8ded85 None None] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:13.474274 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.compute.rpcapi [None req-544f472f-1657-4931-abca-190fcc8ded85 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 27 07:50:13.475227 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-544f472f-1657-4931-abca-190fcc8ded85 None None] Releasing lock "compute-rpcapi-router" {{(pid=117779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 27 07:50:13.500618 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-544f472f-1657-4931-abca-190fcc8ded85 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103901 Jul 27 07:50:13.507605 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 32/74] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:50:13.773754 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-53169191-f97b-40fa-a8fe-b1902175363d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:13.774621 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-53169191-f97b-40fa-a8fe-b1902175363d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:13.781148 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-53169191-f97b-40fa-a8fe-b1902175363d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:13.781496 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-53169191-f97b-40fa-a8fe-b1902175363d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:13.782434 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-53169191-f97b-40fa-a8fe-b1902175363d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:13.782806 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-53169191-f97b-40fa-a8fe-b1902175363d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:13.869655 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7b83a6dd-efde-4826-a8e1-1d7a9944c889 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:13.871168 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-7b83a6dd-efde-4826-a8e1-1d7a9944c889 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:13.884706 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7b83a6dd-efde-4826-a8e1-1d7a9944c889 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:13.885971 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7b83a6dd-efde-4826-a8e1-1d7a9944c889 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:13.887829 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7b83a6dd-efde-4826-a8e1-1d7a9944c889 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:13.888280 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7b83a6dd-efde-4826-a8e1-1d7a9944c889 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:14.128279 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7b83a6dd-efde-4826-a8e1-1d7a9944c889 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:14.141690 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7b83a6dd-efde-4826-a8e1-1d7a9944c889 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.276586 Jul 27 07:50:14.142656 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 33/75] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:13 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:14.151116 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-53169191-f97b-40fa-a8fe-b1902175363d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:14.159029 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-53169191-f97b-40fa-a8fe-b1902175363d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.392750 Jul 27 07:50:14.159617 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 43/76] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:13 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:14.190399 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-4bedcee7-9a79-4f56-a17d-a31c8cd4e3b2 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:14.190794 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-4bedcee7-9a79-4f56-a17d-a31c8cd4e3b2 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:14.197573 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4bedcee7-9a79-4f56-a17d-a31c8cd4e3b2 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:14.198014 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4bedcee7-9a79-4f56-a17d-a31c8cd4e3b2 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:14.198862 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4bedcee7-9a79-4f56-a17d-a31c8cd4e3b2 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:14.199378 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4bedcee7-9a79-4f56-a17d-a31c8cd4e3b2 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:14.416652 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-857e4287-9338-4f57-a2db-3be7ebf2b242 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:14.417255 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-857e4287-9338-4f57-a2db-3be7ebf2b242 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:14.418857 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-4bedcee7-9a79-4f56-a17d-a31c8cd4e3b2 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:14.429588 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-857e4287-9338-4f57-a2db-3be7ebf2b242 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:14.431696 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-4bedcee7-9a79-4f56-a17d-a31c8cd4e3b2 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.244330 Jul 27 07:50:14.432496 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 34/77] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:14 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:14.432857 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-857e4287-9338-4f57-a2db-3be7ebf2b242 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:14.434584 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-857e4287-9338-4f57-a2db-3be7ebf2b242 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:14.435522 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-857e4287-9338-4f57-a2db-3be7ebf2b242 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:14.438147 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0dccb7ee-d73c-474e-a392-281f7fc15595 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:14.438966 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0dccb7ee-d73c-474e-a392-281f7fc15595 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:14.447322 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0dccb7ee-d73c-474e-a392-281f7fc15595 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:14.447997 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0dccb7ee-d73c-474e-a392-281f7fc15595 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:14.449196 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0dccb7ee-d73c-474e-a392-281f7fc15595 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:14.449612 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0dccb7ee-d73c-474e-a392-281f7fc15595 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:14.987164 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-857e4287-9338-4f57-a2db-3be7ebf2b242 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:15.000881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-857e4287-9338-4f57-a2db-3be7ebf2b242 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.587790 Jul 27 07:50:15.003399 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 44/78] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:14 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:15.054278 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0dccb7ee-d73c-474e-a392-281f7fc15595 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:15.065216 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0dccb7ee-d73c-474e-a392-281f7fc15595 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:15.068411 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0dccb7ee-d73c-474e-a392-281f7fc15595 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:15.071258 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0dccb7ee-d73c-474e-a392-281f7fc15595 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1339 microversion: 2.20 time: 0.636881 Jul 27 07:50:15.095061 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 35/79] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:14 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1339 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:15.164734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8bd82e13-e57e-4ce6-8db3-54d7feed0385 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:15.165352 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8bd82e13-e57e-4ce6-8db3-54d7feed0385 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:15.178355 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8bd82e13-e57e-4ce6-8db3-54d7feed0385 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:15.178868 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8bd82e13-e57e-4ce6-8db3-54d7feed0385 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:15.179634 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8bd82e13-e57e-4ce6-8db3-54d7feed0385 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:15.180069 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8bd82e13-e57e-4ce6-8db3-54d7feed0385 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:15.181346 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e2d0323a-fe4e-4362-80f4-280236daed0b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:15.182130 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e2d0323a-fe4e-4362-80f4-280236daed0b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:15.190905 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e2d0323a-fe4e-4362-80f4-280236daed0b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:15.193330 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e2d0323a-fe4e-4362-80f4-280236daed0b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:15.196339 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e2d0323a-fe4e-4362-80f4-280236daed0b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:15.197922 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e2d0323a-fe4e-4362-80f4-280236daed0b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:15.687857 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e2d0323a-fe4e-4362-80f4-280236daed0b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:15.705086 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e2d0323a-fe4e-4362-80f4-280236daed0b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.527380 Jul 27 07:50:15.706666 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 36/80] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:15 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:15.735115 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-aedf717a-1812-4a6f-93af-99f6fd011dc5 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:15.736267 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-aedf717a-1812-4a6f-93af-99f6fd011dc5 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:15.754320 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aedf717a-1812-4a6f-93af-99f6fd011dc5 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:15.755223 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aedf717a-1812-4a6f-93af-99f6fd011dc5 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:15.758546 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aedf717a-1812-4a6f-93af-99f6fd011dc5 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:15.759454 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aedf717a-1812-4a6f-93af-99f6fd011dc5 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:15.913442 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8bd82e13-e57e-4ce6-8db3-54d7feed0385 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:15.932219 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8bd82e13-e57e-4ce6-8db3-54d7feed0385 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.770853 Jul 27 07:50:15.933243 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 45/81] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:15 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:16.026003 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b93b6b56-0f86-4d53-9154-1a0af6edc0cd tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:16.026630 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b93b6b56-0f86-4d53-9154-1a0af6edc0cd tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:16.035010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b93b6b56-0f86-4d53-9154-1a0af6edc0cd tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:16.035462 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b93b6b56-0f86-4d53-9154-1a0af6edc0cd tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:16.039671 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b93b6b56-0f86-4d53-9154-1a0af6edc0cd tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:16.040150 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b93b6b56-0f86-4d53-9154-1a0af6edc0cd tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:16.168694 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-aedf717a-1812-4a6f-93af-99f6fd011dc5 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:16.184835 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-aedf717a-1812-4a6f-93af-99f6fd011dc5 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.475235 Jul 27 07:50:16.187016 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 37/82] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:15 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:16.202241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-56c92e43-cfe4-40d8-9e18-6bf6b716e5f8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:16.202758 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-56c92e43-cfe4-40d8-9e18-6bf6b716e5f8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:16.218366 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-56c92e43-cfe4-40d8-9e18-6bf6b716e5f8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:16.218946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-56c92e43-cfe4-40d8-9e18-6bf6b716e5f8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:16.219844 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-56c92e43-cfe4-40d8-9e18-6bf6b716e5f8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:16.220457 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-56c92e43-cfe4-40d8-9e18-6bf6b716e5f8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:16.351269 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-56c92e43-cfe4-40d8-9e18-6bf6b716e5f8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:16.361677 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-56c92e43-cfe4-40d8-9e18-6bf6b716e5f8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:16.363390 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-56c92e43-cfe4-40d8-9e18-6bf6b716e5f8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:16.364593 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-56c92e43-cfe4-40d8-9e18-6bf6b716e5f8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1339 microversion: 2.20 time: 0.174770 Jul 27 07:50:16.371792 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 38/83] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:16 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1339 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:16.407622 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b93b6b56-0f86-4d53-9154-1a0af6edc0cd tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:16.424180 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b93b6b56-0f86-4d53-9154-1a0af6edc0cd tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.401800 Jul 27 07:50:16.424887 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 46/84] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:16 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:16.630360 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-9759a675-2075-4113-aaaf-99b87b9c0d27 req-d655b776-7dff-4434-9ba0-7d9b6bc62023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480abe1b-7355-48b3-928a-4b32cc678979", "name": "network-vif-plugged", "status": "completed", "tag": "25e0ce5d-89f2-4b0c-92d3-258760019eca"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:50:16.642988 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-9759a675-2075-4113-aaaf-99b87b9c0d27 req-d655b776-7dff-4434-9ba0-7d9b6bc62023 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:16.644059 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-9759a675-2075-4113-aaaf-99b87b9c0d27 req-d655b776-7dff-4434-9ba0-7d9b6bc62023 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:16.666190 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-9759a675-2075-4113-aaaf-99b87b9c0d27 req-d655b776-7dff-4434-9ba0-7d9b6bc62023 service nova] Creating event network-vif-plugged:25e0ce5d-89f2-4b0c-92d3-258760019eca for instance 480abe1b-7355-48b3-928a-4b32cc678979 on hv-cinder-82549 Jul 27 07:50:16.672545 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-9759a675-2075-4113-aaaf-99b87b9c0d27 req-d655b776-7dff-4434-9ba0-7d9b6bc62023 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117314 Jul 27 07:50:16.679893 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 39/85] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:50:16.730784 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-04616c5a-70b5-429f-b009-c53be063e0e9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:16.731704 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-04616c5a-70b5-429f-b009-c53be063e0e9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:16.737806 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=4 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:16.757368 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-04616c5a-70b5-429f-b009-c53be063e0e9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:16.758028 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-04616c5a-70b5-429f-b009-c53be063e0e9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:16.759136 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-04616c5a-70b5-429f-b009-c53be063e0e9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:16.759696 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-04616c5a-70b5-429f-b009-c53be063e0e9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:16.768200 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:16.958215 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c463e8b0-cadd-442e-b4e5-f28b9341b88b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:16.959244 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c463e8b0-cadd-442e-b4e5-f28b9341b88b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:16.976297 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c463e8b0-cadd-442e-b4e5-f28b9341b88b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:16.980617 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c463e8b0-cadd-442e-b4e5-f28b9341b88b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:16.981454 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c463e8b0-cadd-442e-b4e5-f28b9341b88b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:16.983204 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c463e8b0-cadd-442e-b4e5-f28b9341b88b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:17.012531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-04616c5a-70b5-429f-b009-c53be063e0e9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:17.037236 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-04616c5a-70b5-429f-b009-c53be063e0e9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.313267 Jul 27 07:50:17.041463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 47/86] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:16 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:17.197687 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c463e8b0-cadd-442e-b4e5-f28b9341b88b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:17.207280 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c463e8b0-cadd-442e-b4e5-f28b9341b88b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.255683 Jul 27 07:50:17.207503 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 40/87] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:16 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:17.211569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f722ae20-ac64-4290-9a69-9f09c7810e36 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:17.212397 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f722ae20-ac64-4290-9a69-9f09c7810e36 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:17.226939 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f722ae20-ac64-4290-9a69-9f09c7810e36 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:17.227617 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f722ae20-ac64-4290-9a69-9f09c7810e36 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:17.228603 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f722ae20-ac64-4290-9a69-9f09c7810e36 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:17.229245 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f722ae20-ac64-4290-9a69-9f09c7810e36 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:17.393146 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f98da489-037f-4555-beef-801b56b8bc3c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:17.393963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f98da489-037f-4555-beef-801b56b8bc3c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:17.396068 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=6 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:17.402803 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f98da489-037f-4555-beef-801b56b8bc3c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:17.403277 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f98da489-037f-4555-beef-801b56b8bc3c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:17.404047 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f98da489-037f-4555-beef-801b56b8bc3c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:17.404475 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f98da489-037f-4555-beef-801b56b8bc3c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:17.568193 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f98da489-037f-4555-beef-801b56b8bc3c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:17.578241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f98da489-037f-4555-beef-801b56b8bc3c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:17.580864 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f98da489-037f-4555-beef-801b56b8bc3c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:17.582157 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f98da489-037f-4555-beef-801b56b8bc3c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.193144 Jul 27 07:50:17.583086 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 41/88] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:17 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:17.588137 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-727eb3bf-d4b6-476b-9db5-6a7e17b6b27b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:17.589015 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-727eb3bf-d4b6-476b-9db5-6a7e17b6b27b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:17.597853 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-727eb3bf-d4b6-476b-9db5-6a7e17b6b27b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:17.598301 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-727eb3bf-d4b6-476b-9db5-6a7e17b6b27b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:17.599346 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-727eb3bf-d4b6-476b-9db5-6a7e17b6b27b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:17.599931 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-727eb3bf-d4b6-476b-9db5-6a7e17b6b27b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:17.602868 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f722ae20-ac64-4290-9a69-9f09c7810e36 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:17.611356 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f722ae20-ac64-4290-9a69-9f09c7810e36 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.407793 Jul 27 07:50:17.615286 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 48/89] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:17 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:17.801093 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-727eb3bf-d4b6-476b-9db5-6a7e17b6b27b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:17.815210 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-727eb3bf-d4b6-476b-9db5-6a7e17b6b27b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.230855 Jul 27 07:50:17.815784 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 42/90] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:17 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:18.067207 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-75eb72c3-b51d-40e4-9d19-0dcf0556de63 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:18.067887 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-75eb72c3-b51d-40e4-9d19-0dcf0556de63 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:18.082334 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-75eb72c3-b51d-40e4-9d19-0dcf0556de63 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:18.088016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-75eb72c3-b51d-40e4-9d19-0dcf0556de63 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:18.092210 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-75eb72c3-b51d-40e4-9d19-0dcf0556de63 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:18.094608 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-75eb72c3-b51d-40e4-9d19-0dcf0556de63 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:18.178660 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=8 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:18.230346 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-877f2b77-fbea-4f4e-b781-01cea1c4f2e6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:18.231102 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-877f2b77-fbea-4f4e-b781-01cea1c4f2e6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:18.242565 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-877f2b77-fbea-4f4e-b781-01cea1c4f2e6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:18.244268 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-877f2b77-fbea-4f4e-b781-01cea1c4f2e6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:18.246325 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-877f2b77-fbea-4f4e-b781-01cea1c4f2e6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:18.248427 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-877f2b77-fbea-4f4e-b781-01cea1c4f2e6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:18.347441 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-75eb72c3-b51d-40e4-9d19-0dcf0556de63 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:18.367664 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-75eb72c3-b51d-40e4-9d19-0dcf0556de63 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.306086 Jul 27 07:50:18.371740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 49/91] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:18 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:18.472494 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-877f2b77-fbea-4f4e-b781-01cea1c4f2e6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:18.485438 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-877f2b77-fbea-4f4e-b781-01cea1c4f2e6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.261558 Jul 27 07:50:18.486583 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 43/92] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:18 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:18.607810 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3dad7b69-a74b-4733-b853-a925b1aa983a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:18.608433 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3dad7b69-a74b-4733-b853-a925b1aa983a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:18.623762 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3dad7b69-a74b-4733-b853-a925b1aa983a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:18.624424 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3dad7b69-a74b-4733-b853-a925b1aa983a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:18.625368 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3dad7b69-a74b-4733-b853-a925b1aa983a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:18.625958 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3dad7b69-a74b-4733-b853-a925b1aa983a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:18.639121 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-3b909127-0d22-4765-987e-a75261113fb6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:18.639916 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-3b909127-0d22-4765-987e-a75261113fb6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:18.649124 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3b909127-0d22-4765-987e-a75261113fb6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:18.651519 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3b909127-0d22-4765-987e-a75261113fb6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:18.652494 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3b909127-0d22-4765-987e-a75261113fb6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:18.655167 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3b909127-0d22-4765-987e-a75261113fb6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:18.971414 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3b909127-0d22-4765-987e-a75261113fb6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:18.979159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=100 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:18.984260 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-3b909127-0d22-4765-987e-a75261113fb6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.348111 Jul 27 07:50:18.985326 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 44/93] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:18 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:18.991273 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-3525e789-9a34-4670-a682-1ab8d2dffaa5 req-48b3fa2e-5bf0-402c-9d65-b544f78c7486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d14cae7-2ec9-4ab1-94c5-b63982ffc251", "name": "network-vif-plugged", "status": "completed", "tag": "f7533591-85c2-41a4-9ada-d6c9eebf0053"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:50:19.006094 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-3525e789-9a34-4670-a682-1ab8d2dffaa5 req-48b3fa2e-5bf0-402c-9d65-b544f78c7486 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:19.007092 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-3525e789-9a34-4670-a682-1ab8d2dffaa5 req-48b3fa2e-5bf0-402c-9d65-b544f78c7486 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:19.041359 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-3525e789-9a34-4670-a682-1ab8d2dffaa5 req-48b3fa2e-5bf0-402c-9d65-b544f78c7486 service nova] Creating event network-vif-plugged:f7533591-85c2-41a4-9ada-d6c9eebf0053 for instance 0d14cae7-2ec9-4ab1-94c5-b63982ffc251 on hv-cinder-82549 Jul 27 07:50:19.051087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-3525e789-9a34-4670-a682-1ab8d2dffaa5 req-48b3fa2e-5bf0-402c-9d65-b544f78c7486 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063769 Jul 27 07:50:19.053626 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 45/94] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:50:19.071683 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-014c2c43-dc30-4a4c-b94e-6f9d4af6acb6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:19.073202 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-014c2c43-dc30-4a4c-b94e-6f9d4af6acb6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:19.083483 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-014c2c43-dc30-4a4c-b94e-6f9d4af6acb6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:19.084803 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-014c2c43-dc30-4a4c-b94e-6f9d4af6acb6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:19.085874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-014c2c43-dc30-4a4c-b94e-6f9d4af6acb6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:19.087043 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-014c2c43-dc30-4a4c-b94e-6f9d4af6acb6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:19.236655 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3dad7b69-a74b-4733-b853-a925b1aa983a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:19.247245 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3dad7b69-a74b-4733-b853-a925b1aa983a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:19.248876 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3dad7b69-a74b-4733-b853-a925b1aa983a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:19.250399 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3dad7b69-a74b-4733-b853-a925b1aa983a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.647181 Jul 27 07:50:19.251654 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 50/95] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:18 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:19.392373 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-014c2c43-dc30-4a4c-b94e-6f9d4af6acb6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:19.393885 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-30c5f91a-832e-47a0-bff7-25dbe46926a1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:19.395888 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-30c5f91a-832e-47a0-bff7-25dbe46926a1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:19.404227 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-014c2c43-dc30-4a4c-b94e-6f9d4af6acb6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.344230 Jul 27 07:50:19.405530 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30c5f91a-832e-47a0-bff7-25dbe46926a1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:19.406061 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 46/96] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:19 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:19.419822 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30c5f91a-832e-47a0-bff7-25dbe46926a1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:19.420788 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30c5f91a-832e-47a0-bff7-25dbe46926a1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:19.421328 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30c5f91a-832e-47a0-bff7-25dbe46926a1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:19.580375 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-30c5f91a-832e-47a0-bff7-25dbe46926a1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:19.589525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-30c5f91a-832e-47a0-bff7-25dbe46926a1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.200413 Jul 27 07:50:19.590010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 51/97] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:19 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:19.595461 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0da964a9-f65c-40ee-97aa-f9a31a087185 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:19.596257 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0da964a9-f65c-40ee-97aa-f9a31a087185 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:19.602664 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0da964a9-f65c-40ee-97aa-f9a31a087185 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:19.603337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0da964a9-f65c-40ee-97aa-f9a31a087185 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:19.604258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0da964a9-f65c-40ee-97aa-f9a31a087185 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:19.605398 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0da964a9-f65c-40ee-97aa-f9a31a087185 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:19.734746 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-fdba9d3c-f8b8-4e6f-98ec-6636bbc9f561 req-e08a1d79-909c-4bec-9088-ad2047a92dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "880126db-79f5-4c11-a0b5-85a612a1662a", "tag": "4acbfc37-e1fc-4b8f-a717-ec89154e30e4"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:50:19.746186 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-fdba9d3c-f8b8-4e6f-98ec-6636bbc9f561 req-e08a1d79-909c-4bec-9088-ad2047a92dd3 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:19.746631 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-fdba9d3c-f8b8-4e6f-98ec-6636bbc9f561 req-e08a1d79-909c-4bec-9088-ad2047a92dd3 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:19.754787 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0da964a9-f65c-40ee-97aa-f9a31a087185 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:19.758022 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-fdba9d3c-f8b8-4e6f-98ec-6636bbc9f561 req-e08a1d79-909c-4bec-9088-ad2047a92dd3 service nova] Creating event network-changed:4acbfc37-e1fc-4b8f-a717-ec89154e30e4 for instance 880126db-79f5-4c11-a0b5-85a612a1662a on hv-cinder-82549 Jul 27 07:50:19.762794 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0da964a9-f65c-40ee-97aa-f9a31a087185 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.170893 Jul 27 07:50:19.763140 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-fdba9d3c-f8b8-4e6f-98ec-6636bbc9f561 req-e08a1d79-909c-4bec-9088-ad2047a92dd3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.281669 Jul 27 07:50:19.763625 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 52/98] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:19 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:19.764088 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 47/99] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:50:20.009572 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-198399a3-b485-4fab-9092-415fa1db13e6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:20.010372 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-198399a3-b485-4fab-9092-415fa1db13e6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:20.022611 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-198399a3-b485-4fab-9092-415fa1db13e6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:20.023879 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-198399a3-b485-4fab-9092-415fa1db13e6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:20.026437 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-198399a3-b485-4fab-9092-415fa1db13e6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:20.027664 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-198399a3-b485-4fab-9092-415fa1db13e6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:20.279811 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e31303b2-0901-4c37-899b-69251f61183c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:20.280570 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e31303b2-0901-4c37-899b-69251f61183c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:20.292652 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e31303b2-0901-4c37-899b-69251f61183c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:20.293867 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e31303b2-0901-4c37-899b-69251f61183c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:20.296863 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e31303b2-0901-4c37-899b-69251f61183c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:20.299564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e31303b2-0901-4c37-899b-69251f61183c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:20.905937 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-198399a3-b485-4fab-9092-415fa1db13e6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:20.916859 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-198399a3-b485-4fab-9092-415fa1db13e6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.912131 Jul 27 07:50:20.920324 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 53/100] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:20 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:20.926512 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2f721985-c560-4154-aad7-fb7ac6151ab6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:20.928112 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2f721985-c560-4154-aad7-fb7ac6151ab6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:20.939048 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2f721985-c560-4154-aad7-fb7ac6151ab6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:20.942164 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2f721985-c560-4154-aad7-fb7ac6151ab6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:20.944170 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2f721985-c560-4154-aad7-fb7ac6151ab6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:20.944801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2f721985-c560-4154-aad7-fb7ac6151ab6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:21.144754 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e31303b2-0901-4c37-899b-69251f61183c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:21.153239 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e31303b2-0901-4c37-899b-69251f61183c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:21.154656 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e31303b2-0901-4c37-899b-69251f61183c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:21.164160 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e31303b2-0901-4c37-899b-69251f61183c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.889202 Jul 27 07:50:21.164768 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 48/101] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:20 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:21.185403 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-19d1ebb6-5623-49d2-94d2-65fbfe4ee753 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:21.186183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-19d1ebb6-5623-49d2-94d2-65fbfe4ee753 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:21.201949 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-19d1ebb6-5623-49d2-94d2-65fbfe4ee753 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:21.201949 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-19d1ebb6-5623-49d2-94d2-65fbfe4ee753 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:21.207304 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-19d1ebb6-5623-49d2-94d2-65fbfe4ee753 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:21.208400 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-19d1ebb6-5623-49d2-94d2-65fbfe4ee753 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:21.590401 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2f721985-c560-4154-aad7-fb7ac6151ab6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:21.601152 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2f721985-c560-4154-aad7-fb7ac6151ab6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.678962 Jul 27 07:50:21.602170 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 54/102] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:20 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:21.607718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-be884386-b393-41bc-a5ec-b786cb2dba8b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:21.608426 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-be884386-b393-41bc-a5ec-b786cb2dba8b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:21.618877 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-be884386-b393-41bc-a5ec-b786cb2dba8b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:21.619947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-be884386-b393-41bc-a5ec-b786cb2dba8b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:21.621586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-be884386-b393-41bc-a5ec-b786cb2dba8b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:21.622634 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-be884386-b393-41bc-a5ec-b786cb2dba8b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:21.690003 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-19d1ebb6-5623-49d2-94d2-65fbfe4ee753 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:21.698033 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-19d1ebb6-5623-49d2-94d2-65fbfe4ee753 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.532062 Jul 27 07:50:21.698605 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 49/103] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:21 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:21.765575 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-be884386-b393-41bc-a5ec-b786cb2dba8b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:21.772921 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-be884386-b393-41bc-a5ec-b786cb2dba8b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.169339 Jul 27 07:50:21.773487 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 55/104] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:21 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:21.940701 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-99d33ec3-009f-4ade-9913-f26806d09597 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:21.941829 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-99d33ec3-009f-4ade-9913-f26806d09597 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:21.947766 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-99d33ec3-009f-4ade-9913-f26806d09597 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:21.948213 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-99d33ec3-009f-4ade-9913-f26806d09597 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:21.949003 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-99d33ec3-009f-4ade-9913-f26806d09597 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:21.949406 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-99d33ec3-009f-4ade-9913-f26806d09597 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:22.180278 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-99d33ec3-009f-4ade-9913-f26806d09597 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:22.193674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-31ac913b-7af6-4b7f-b4a4-a444bbbf6ba8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:22.194283 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-31ac913b-7af6-4b7f-b4a4-a444bbbf6ba8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:22.199140 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-99d33ec3-009f-4ade-9913-f26806d09597 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.262305 Jul 27 07:50:22.199728 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 50/105] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:21 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:22.203692 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-31ac913b-7af6-4b7f-b4a4-a444bbbf6ba8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:22.204149 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-31ac913b-7af6-4b7f-b4a4-a444bbbf6ba8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:22.205037 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-31ac913b-7af6-4b7f-b4a4-a444bbbf6ba8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:22.205383 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-31ac913b-7af6-4b7f-b4a4-a444bbbf6ba8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:22.340892 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-31ac913b-7af6-4b7f-b4a4-a444bbbf6ba8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:22.350001 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-31ac913b-7af6-4b7f-b4a4-a444bbbf6ba8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:22.351546 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-31ac913b-7af6-4b7f-b4a4-a444bbbf6ba8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:22.352689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-31ac913b-7af6-4b7f-b4a4-a444bbbf6ba8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.163569 Jul 27 07:50:22.353295 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 56/106] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:22 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:22.624902 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2f3eb601-e67c-4f07-9f7b-0b010984cfb0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:22.625988 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2f3eb601-e67c-4f07-9f7b-0b010984cfb0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:22.634408 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2f3eb601-e67c-4f07-9f7b-0b010984cfb0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:22.634863 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2f3eb601-e67c-4f07-9f7b-0b010984cfb0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:22.635685 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2f3eb601-e67c-4f07-9f7b-0b010984cfb0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:22.636274 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2f3eb601-e67c-4f07-9f7b-0b010984cfb0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:22.719377 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-57220e7d-f671-4ad6-bd62-3aeeaa5a9a61 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:22.720738 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-57220e7d-f671-4ad6-bd62-3aeeaa5a9a61 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:22.734807 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-57220e7d-f671-4ad6-bd62-3aeeaa5a9a61 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:22.735498 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-57220e7d-f671-4ad6-bd62-3aeeaa5a9a61 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:22.736433 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-57220e7d-f671-4ad6-bd62-3aeeaa5a9a61 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:22.737017 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-57220e7d-f671-4ad6-bd62-3aeeaa5a9a61 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:22.808264 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2f3eb601-e67c-4f07-9f7b-0b010984cfb0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:22.817728 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2f3eb601-e67c-4f07-9f7b-0b010984cfb0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.199630 Jul 27 07:50:22.832804 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 51/107] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:22 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:22.845552 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-fd98f930-8c0a-4ec4-b084-2ab83a5a8c6c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:22.855059 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-fd98f930-8c0a-4ec4-b084-2ab83a5a8c6c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:22.862033 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fd98f930-8c0a-4ec4-b084-2ab83a5a8c6c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:22.863841 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fd98f930-8c0a-4ec4-b084-2ab83a5a8c6c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:22.865433 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fd98f930-8c0a-4ec4-b084-2ab83a5a8c6c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:22.871802 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fd98f930-8c0a-4ec4-b084-2ab83a5a8c6c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:22.927738 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-57220e7d-f671-4ad6-bd62-3aeeaa5a9a61 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:22.937279 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-57220e7d-f671-4ad6-bd62-3aeeaa5a9a61 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.221628 Jul 27 07:50:22.954978 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 57/108] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:22 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:22.963363 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-8a74964c-2c17-4373-9098-d5120c12e072 req-e9244f9b-1e03-427f-be7e-d64cc0a248b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257c6f7b-d45d-499a-ade2-0b3371d09360", "name": "network-vif-plugged", "status": "completed", "tag": "f9450ccc-33c3-4bb9-9fe8-897c11b4d17a"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:50:22.978265 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-8a74964c-2c17-4373-9098-d5120c12e072 req-e9244f9b-1e03-427f-be7e-d64cc0a248b3 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:22.978952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-8a74964c-2c17-4373-9098-d5120c12e072 req-e9244f9b-1e03-427f-be7e-d64cc0a248b3 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:22.992463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-8a74964c-2c17-4373-9098-d5120c12e072 req-e9244f9b-1e03-427f-be7e-d64cc0a248b3 service nova] Creating event network-vif-plugged:f9450ccc-33c3-4bb9-9fe8-897c11b4d17a for instance 257c6f7b-d45d-499a-ade2-0b3371d09360 on hv-cinder-82549 Jul 27 07:50:23.005482 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-8a74964c-2c17-4373-9098-d5120c12e072 req-e9244f9b-1e03-427f-be7e-d64cc0a248b3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042138 Jul 27 07:50:23.006531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 58/109] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:50:23.057823 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-fd98f930-8c0a-4ec4-b084-2ab83a5a8c6c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:23.065563 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-fd98f930-8c0a-4ec4-b084-2ab83a5a8c6c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.231305 Jul 27 07:50:23.066840 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 52/110] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:22 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:23.220901 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0106bc55-5147-446a-9e8a-bae43265de6a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:23.221574 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0106bc55-5147-446a-9e8a-bae43265de6a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:23.228089 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0106bc55-5147-446a-9e8a-bae43265de6a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:23.228537 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0106bc55-5147-446a-9e8a-bae43265de6a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:23.229729 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0106bc55-5147-446a-9e8a-bae43265de6a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:23.230196 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0106bc55-5147-446a-9e8a-bae43265de6a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:23.361056 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0106bc55-5147-446a-9e8a-bae43265de6a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:23.369401 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0106bc55-5147-446a-9e8a-bae43265de6a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.152498 Jul 27 07:50:23.370262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 59/111] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:23 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:23.375658 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-8ed1b7bf-68f7-45c9-8fb9-024504f578ad tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:23.376262 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-8ed1b7bf-68f7-45c9-8fb9-024504f578ad tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:23.382930 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8ed1b7bf-68f7-45c9-8fb9-024504f578ad tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:23.383372 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8ed1b7bf-68f7-45c9-8fb9-024504f578ad tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:23.384121 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8ed1b7bf-68f7-45c9-8fb9-024504f578ad tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:23.384545 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8ed1b7bf-68f7-45c9-8fb9-024504f578ad tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:23.471698 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=4 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:23.514485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8ed1b7bf-68f7-45c9-8fb9-024504f578ad tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:23.522590 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8ed1b7bf-68f7-45c9-8fb9-024504f578ad tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:23.524155 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8ed1b7bf-68f7-45c9-8fb9-024504f578ad tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:23.525301 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-8ed1b7bf-68f7-45c9-8fb9-024504f578ad tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.153435 Jul 27 07:50:23.525873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 53/112] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:23 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:23.842537 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-96ede6e7-e82b-41ce-8813-161738b645a5 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:23.843174 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-96ede6e7-e82b-41ce-8813-161738b645a5 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:23.850014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-96ede6e7-e82b-41ce-8813-161738b645a5 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:23.850473 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-96ede6e7-e82b-41ce-8813-161738b645a5 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:23.851264 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-96ede6e7-e82b-41ce-8813-161738b645a5 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:23.851703 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-96ede6e7-e82b-41ce-8813-161738b645a5 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:23.961071 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-26b29b16-95f9-4502-a8ba-e663a063f277 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:23.961683 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-26b29b16-95f9-4502-a8ba-e663a063f277 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:23.967699 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-26b29b16-95f9-4502-a8ba-e663a063f277 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:23.968148 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-26b29b16-95f9-4502-a8ba-e663a063f277 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:23.968925 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-26b29b16-95f9-4502-a8ba-e663a063f277 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:23.969360 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-26b29b16-95f9-4502-a8ba-e663a063f277 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:23.981469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-96ede6e7-e82b-41ce-8813-161738b645a5 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:23.989489 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-96ede6e7-e82b-41ce-8813-161738b645a5 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.150750 Jul 27 07:50:23.990064 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 60/113] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:23 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:24.092458 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8225e56c-7a8d-4870-bdf6-6d3a18eaf49e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:24.093226 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8225e56c-7a8d-4870-bdf6-6d3a18eaf49e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:24.100261 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8225e56c-7a8d-4870-bdf6-6d3a18eaf49e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:24.100784 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8225e56c-7a8d-4870-bdf6-6d3a18eaf49e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:24.100980 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-26b29b16-95f9-4502-a8ba-e663a063f277 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:24.101660 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8225e56c-7a8d-4870-bdf6-6d3a18eaf49e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:24.102096 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8225e56c-7a8d-4870-bdf6-6d3a18eaf49e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:24.108307 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-26b29b16-95f9-4502-a8ba-e663a063f277 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.151193 Jul 27 07:50:24.108866 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 54/114] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:23 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:24.231374 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8225e56c-7a8d-4870-bdf6-6d3a18eaf49e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:24.238978 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8225e56c-7a8d-4870-bdf6-6d3a18eaf49e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.150378 Jul 27 07:50:24.239537 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 61/115] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:24 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:24.391219 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c99c311b-e47c-4319-bfd6-1d49916a3863 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:24.391755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c99c311b-e47c-4319-bfd6-1d49916a3863 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:24.398384 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c99c311b-e47c-4319-bfd6-1d49916a3863 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:24.398830 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c99c311b-e47c-4319-bfd6-1d49916a3863 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:24.399630 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c99c311b-e47c-4319-bfd6-1d49916a3863 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:24.400062 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c99c311b-e47c-4319-bfd6-1d49916a3863 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:24.527084 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c99c311b-e47c-4319-bfd6-1d49916a3863 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:24.534528 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c99c311b-e47c-4319-bfd6-1d49916a3863 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.147292 Jul 27 07:50:24.535128 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 55/116] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:24 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:24.548482 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b9feb052-d6c7-4cdc-af79-783088eee0da tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:24.549235 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b9feb052-d6c7-4cdc-af79-783088eee0da tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:24.555776 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b9feb052-d6c7-4cdc-af79-783088eee0da tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:24.556221 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b9feb052-d6c7-4cdc-af79-783088eee0da tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:24.556991 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b9feb052-d6c7-4cdc-af79-783088eee0da tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:24.557422 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b9feb052-d6c7-4cdc-af79-783088eee0da tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:24.687665 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b9feb052-d6c7-4cdc-af79-783088eee0da tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:24.695706 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b9feb052-d6c7-4cdc-af79-783088eee0da tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:24.697215 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b9feb052-d6c7-4cdc-af79-783088eee0da tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:24.698319 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b9feb052-d6c7-4cdc-af79-783088eee0da tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.154617 Jul 27 07:50:24.698868 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 62/117] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:24 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:25.009943 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-31a62afb-b607-4ef2-8162-d693e27b6610 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:25.010471 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-31a62afb-b607-4ef2-8162-d693e27b6610 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:25.016450 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-31a62afb-b607-4ef2-8162-d693e27b6610 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:25.016896 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-31a62afb-b607-4ef2-8162-d693e27b6610 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:25.017643 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-31a62afb-b607-4ef2-8162-d693e27b6610 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:25.018073 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-31a62afb-b607-4ef2-8162-d693e27b6610 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:25.129425 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-795afef6-6548-45f1-b640-0bc11acb809a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:25.130177 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-795afef6-6548-45f1-b640-0bc11acb809a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:25.137589 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-795afef6-6548-45f1-b640-0bc11acb809a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:25.138136 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-795afef6-6548-45f1-b640-0bc11acb809a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:25.138945 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-795afef6-6548-45f1-b640-0bc11acb809a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:25.139388 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-795afef6-6548-45f1-b640-0bc11acb809a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:25.150257 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-31a62afb-b607-4ef2-8162-d693e27b6610 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:25.159737 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-31a62afb-b607-4ef2-8162-d693e27b6610 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.153561 Jul 27 07:50:25.160321 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 56/118] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:25 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:25.260092 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f02f1c36-95cc-4a38-b75e-6759a4416ac3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:25.260637 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f02f1c36-95cc-4a38-b75e-6759a4416ac3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:25.267017 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f02f1c36-95cc-4a38-b75e-6759a4416ac3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:25.267477 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f02f1c36-95cc-4a38-b75e-6759a4416ac3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:25.268247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f02f1c36-95cc-4a38-b75e-6759a4416ac3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:25.268683 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f02f1c36-95cc-4a38-b75e-6759a4416ac3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:25.274203 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-795afef6-6548-45f1-b640-0bc11acb809a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:25.281655 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-795afef6-6548-45f1-b640-0bc11acb809a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.156594 Jul 27 07:50:25.282229 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 63/119] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:25 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:25.399411 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f02f1c36-95cc-4a38-b75e-6759a4416ac3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:25.406870 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f02f1c36-95cc-4a38-b75e-6759a4416ac3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.150727 Jul 27 07:50:25.407463 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 57/120] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:25 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:25.555328 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2b0989d1-3e45-498c-af7a-02ba874cecf0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:25.555837 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2b0989d1-3e45-498c-af7a-02ba874cecf0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:25.561850 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2b0989d1-3e45-498c-af7a-02ba874cecf0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:25.562286 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2b0989d1-3e45-498c-af7a-02ba874cecf0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:25.563077 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2b0989d1-3e45-498c-af7a-02ba874cecf0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:25.563507 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2b0989d1-3e45-498c-af7a-02ba874cecf0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:25.581664 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:25.689031 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2b0989d1-3e45-498c-af7a-02ba874cecf0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:25.697168 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2b0989d1-3e45-498c-af7a-02ba874cecf0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.145734 Jul 27 07:50:25.697761 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 64/121] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:25 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:25.720369 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1bd1a80e-6da1-4e83-9f81-bec45cd49683 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:25.720971 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1bd1a80e-6da1-4e83-9f81-bec45cd49683 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:25.727148 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1bd1a80e-6da1-4e83-9f81-bec45cd49683 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:25.727674 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1bd1a80e-6da1-4e83-9f81-bec45cd49683 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:25.728407 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1bd1a80e-6da1-4e83-9f81-bec45cd49683 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:25.728734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1bd1a80e-6da1-4e83-9f81-bec45cd49683 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:25.854708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1bd1a80e-6da1-4e83-9f81-bec45cd49683 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:25.863229 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1bd1a80e-6da1-4e83-9f81-bec45cd49683 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:25.864757 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1bd1a80e-6da1-4e83-9f81-bec45cd49683 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:25.865857 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1bd1a80e-6da1-4e83-9f81-bec45cd49683 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.149413 Jul 27 07:50:25.866415 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 58/122] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:25 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:26.180013 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-58378e0e-26da-4a06-be88-c81504b24ff1 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:26.180564 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-58378e0e-26da-4a06-be88-c81504b24ff1 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:26.186992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-58378e0e-26da-4a06-be88-c81504b24ff1 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:26.187443 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-58378e0e-26da-4a06-be88-c81504b24ff1 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:26.188337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-58378e0e-26da-4a06-be88-c81504b24ff1 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:26.188796 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-58378e0e-26da-4a06-be88-c81504b24ff1 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:26.301999 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-78b23d18-d735-436e-b29a-296fe7f026b2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:26.302608 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-78b23d18-d735-436e-b29a-296fe7f026b2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:26.308553 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-78b23d18-d735-436e-b29a-296fe7f026b2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:26.308993 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-78b23d18-d735-436e-b29a-296fe7f026b2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:26.309753 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-78b23d18-d735-436e-b29a-296fe7f026b2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:26.310185 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-78b23d18-d735-436e-b29a-296fe7f026b2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:26.322292 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-58378e0e-26da-4a06-be88-c81504b24ff1 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:26.329918 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-58378e0e-26da-4a06-be88-c81504b24ff1 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.153829 Jul 27 07:50:26.330484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 65/123] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:26 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:26.428116 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4a203264-c9d5-484b-8768-c3d9172bef4d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:26.429235 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4a203264-c9d5-484b-8768-c3d9172bef4d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:26.437486 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4a203264-c9d5-484b-8768-c3d9172bef4d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:26.438017 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4a203264-c9d5-484b-8768-c3d9172bef4d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:26.439205 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4a203264-c9d5-484b-8768-c3d9172bef4d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:26.440037 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4a203264-c9d5-484b-8768-c3d9172bef4d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:26.475875 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-78b23d18-d735-436e-b29a-296fe7f026b2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:26.484851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-78b23d18-d735-436e-b29a-296fe7f026b2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.187112 Jul 27 07:50:26.485905 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 59/124] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:26 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:26.582127 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4a203264-c9d5-484b-8768-c3d9172bef4d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:26.596512 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4a203264-c9d5-484b-8768-c3d9172bef4d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.173199 Jul 27 07:50:26.597178 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 66/125] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:26 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:26.719577 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e96976f1-3d05-4948-9d47-fd757979d2e6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:26.720370 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e96976f1-3d05-4948-9d47-fd757979d2e6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:26.723860 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:26.728276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e96976f1-3d05-4948-9d47-fd757979d2e6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:26.728721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e96976f1-3d05-4948-9d47-fd757979d2e6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:26.729495 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e96976f1-3d05-4948-9d47-fd757979d2e6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:26.729926 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e96976f1-3d05-4948-9d47-fd757979d2e6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:26.867888 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e96976f1-3d05-4948-9d47-fd757979d2e6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:26.875339 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e96976f1-3d05-4948-9d47-fd757979d2e6 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.161085 Jul 27 07:50:26.875910 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 60/126] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:26 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:26.888634 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3d436190-658f-453f-8a8b-68d56bf152c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:26.889378 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3d436190-658f-453f-8a8b-68d56bf152c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:26.896200 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3d436190-658f-453f-8a8b-68d56bf152c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:26.896642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3d436190-658f-453f-8a8b-68d56bf152c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:26.897462 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3d436190-658f-453f-8a8b-68d56bf152c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:26.897840 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3d436190-658f-453f-8a8b-68d56bf152c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:27.034829 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3d436190-658f-453f-8a8b-68d56bf152c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:27.042870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3d436190-658f-453f-8a8b-68d56bf152c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:27.044418 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3d436190-658f-453f-8a8b-68d56bf152c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:27.045521 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3d436190-658f-453f-8a8b-68d56bf152c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.160798 Jul 27 07:50:27.046126 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 67/127] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:26 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:27.350051 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ed460e21-f0ea-4cbf-94a7-fe8b9be3ac9e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:27.350778 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ed460e21-f0ea-4cbf-94a7-fe8b9be3ac9e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:27.356700 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ed460e21-f0ea-4cbf-94a7-fe8b9be3ac9e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:27.357141 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ed460e21-f0ea-4cbf-94a7-fe8b9be3ac9e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:27.357890 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ed460e21-f0ea-4cbf-94a7-fe8b9be3ac9e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:27.358315 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ed460e21-f0ea-4cbf-94a7-fe8b9be3ac9e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:27.487042 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ed460e21-f0ea-4cbf-94a7-fe8b9be3ac9e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:27.495459 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ed460e21-f0ea-4cbf-94a7-fe8b9be3ac9e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.149531 Jul 27 07:50:27.496065 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 61/128] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:27 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:27.505502 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-66a33139-a801-44ac-b515-070f2b0e7b73 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:27.506122 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-66a33139-a801-44ac-b515-070f2b0e7b73 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:27.512262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-66a33139-a801-44ac-b515-070f2b0e7b73 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:27.512707 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-66a33139-a801-44ac-b515-070f2b0e7b73 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:27.513467 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-66a33139-a801-44ac-b515-070f2b0e7b73 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:27.513904 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-66a33139-a801-44ac-b515-070f2b0e7b73 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:27.620565 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-6fde9d1f-b0dd-4c00-9e83-7764121d9582 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:27.621321 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-6fde9d1f-b0dd-4c00-9e83-7764121d9582 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:27.629035 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6fde9d1f-b0dd-4c00-9e83-7764121d9582 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:27.629849 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6fde9d1f-b0dd-4c00-9e83-7764121d9582 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:27.630695 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6fde9d1f-b0dd-4c00-9e83-7764121d9582 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:27.631158 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6fde9d1f-b0dd-4c00-9e83-7764121d9582 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:27.648414 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-66a33139-a801-44ac-b515-070f2b0e7b73 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:27.655992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-66a33139-a801-44ac-b515-070f2b0e7b73 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.154369 Jul 27 07:50:27.656563 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 68/129] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:27 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:27.763496 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-6fde9d1f-b0dd-4c00-9e83-7764121d9582 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:27.765725 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=100 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:27.774119 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-6fde9d1f-b0dd-4c00-9e83-7764121d9582 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.159595 Jul 27 07:50:27.774742 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 62/130] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:27 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:27.899401 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a4fb19fe-6f02-401a-907f-cc66d963654e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:27.900098 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a4fb19fe-6f02-401a-907f-cc66d963654e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:27.906380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a4fb19fe-6f02-401a-907f-cc66d963654e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:27.906828 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a4fb19fe-6f02-401a-907f-cc66d963654e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:27.907622 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a4fb19fe-6f02-401a-907f-cc66d963654e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:27.908059 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a4fb19fe-6f02-401a-907f-cc66d963654e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:28.053112 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a4fb19fe-6f02-401a-907f-cc66d963654e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:28.060519 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a4fb19fe-6f02-401a-907f-cc66d963654e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.166705 Jul 27 07:50:28.061086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 69/131] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:27 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:28.068437 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c76c0508-8e2f-485b-a67c-9cbcf7c5b2a8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:28.069075 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c76c0508-8e2f-485b-a67c-9cbcf7c5b2a8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:28.075233 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c76c0508-8e2f-485b-a67c-9cbcf7c5b2a8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:28.075671 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c76c0508-8e2f-485b-a67c-9cbcf7c5b2a8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:28.076442 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c76c0508-8e2f-485b-a67c-9cbcf7c5b2a8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:28.076972 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c76c0508-8e2f-485b-a67c-9cbcf7c5b2a8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:28.210326 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c76c0508-8e2f-485b-a67c-9cbcf7c5b2a8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:28.221445 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c76c0508-8e2f-485b-a67c-9cbcf7c5b2a8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:28.223045 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c76c0508-8e2f-485b-a67c-9cbcf7c5b2a8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:28.224422 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c76c0508-8e2f-485b-a67c-9cbcf7c5b2a8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.159560 Jul 27 07:50:28.225766 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 63/132] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:28 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:28.516098 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-413ae25e-9663-4f41-a529-c29a35f1b9e4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:28.516712 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-413ae25e-9663-4f41-a529-c29a35f1b9e4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:28.523020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-413ae25e-9663-4f41-a529-c29a35f1b9e4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:28.523471 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-413ae25e-9663-4f41-a529-c29a35f1b9e4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:28.524244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-413ae25e-9663-4f41-a529-c29a35f1b9e4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:28.524681 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-413ae25e-9663-4f41-a529-c29a35f1b9e4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:28.658908 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-413ae25e-9663-4f41-a529-c29a35f1b9e4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:28.666287 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-413ae25e-9663-4f41-a529-c29a35f1b9e4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.154092 Jul 27 07:50:28.666843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 70/133] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:28 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:28.677838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-138cb8a8-b375-46d9-bae4-fab777bdf6e3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:28.678440 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-138cb8a8-b375-46d9-bae4-fab777bdf6e3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:28.684564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-138cb8a8-b375-46d9-bae4-fab777bdf6e3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:28.684944 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-138cb8a8-b375-46d9-bae4-fab777bdf6e3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:28.685690 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-138cb8a8-b375-46d9-bae4-fab777bdf6e3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:28.686114 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-138cb8a8-b375-46d9-bae4-fab777bdf6e3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:28.797803 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-17d6d05f-ed55-4e4f-a5d6-586cfba5f6d5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:28.798497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-17d6d05f-ed55-4e4f-a5d6-586cfba5f6d5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:28.805259 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-17d6d05f-ed55-4e4f-a5d6-586cfba5f6d5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:28.805711 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-17d6d05f-ed55-4e4f-a5d6-586cfba5f6d5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:28.806516 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-17d6d05f-ed55-4e4f-a5d6-586cfba5f6d5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:28.807002 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-17d6d05f-ed55-4e4f-a5d6-586cfba5f6d5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:28.819466 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-138cb8a8-b375-46d9-bae4-fab777bdf6e3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:28.826912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-138cb8a8-b375-46d9-bae4-fab777bdf6e3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.153327 Jul 27 07:50:28.827476 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 64/134] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:28 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:28.946642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-17d6d05f-ed55-4e4f-a5d6-586cfba5f6d5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:28.957340 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-17d6d05f-ed55-4e4f-a5d6-586cfba5f6d5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.163187 Jul 27 07:50:28.957934 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 71/135] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:28 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:29.084153 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b62fa51b-6ff7-43d3-80dd-90de08cb683e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:29.084797 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b62fa51b-6ff7-43d3-80dd-90de08cb683e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:29.090835 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b62fa51b-6ff7-43d3-80dd-90de08cb683e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:29.091305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b62fa51b-6ff7-43d3-80dd-90de08cb683e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:29.092059 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b62fa51b-6ff7-43d3-80dd-90de08cb683e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:29.092495 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b62fa51b-6ff7-43d3-80dd-90de08cb683e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:29.231936 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b62fa51b-6ff7-43d3-80dd-90de08cb683e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:29.239915 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b62fa51b-6ff7-43d3-80dd-90de08cb683e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.159625 Jul 27 07:50:29.240476 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 65/136] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:29 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:29.253407 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-951f2dc9-6a34-4d04-8667-aa532dbbd4ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:29.254008 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-951f2dc9-6a34-4d04-8667-aa532dbbd4ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:29.260273 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-951f2dc9-6a34-4d04-8667-aa532dbbd4ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:29.260709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-951f2dc9-6a34-4d04-8667-aa532dbbd4ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:29.261531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-951f2dc9-6a34-4d04-8667-aa532dbbd4ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:29.262023 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-951f2dc9-6a34-4d04-8667-aa532dbbd4ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:29.395079 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-951f2dc9-6a34-4d04-8667-aa532dbbd4ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:29.403000 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-951f2dc9-6a34-4d04-8667-aa532dbbd4ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:29.404515 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-951f2dc9-6a34-4d04-8667-aa532dbbd4ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:29.405622 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-951f2dc9-6a34-4d04-8667-aa532dbbd4ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.156062 Jul 27 07:50:29.406189 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 72/137] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:29 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:29.687237 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e0b82212-b64c-4d88-b0c0-da6ecd89c8c3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:29.687846 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e0b82212-b64c-4d88-b0c0-da6ecd89c8c3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:29.694362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e0b82212-b64c-4d88-b0c0-da6ecd89c8c3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:29.694800 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e0b82212-b64c-4d88-b0c0-da6ecd89c8c3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:29.695577 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e0b82212-b64c-4d88-b0c0-da6ecd89c8c3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:29.696007 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e0b82212-b64c-4d88-b0c0-da6ecd89c8c3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:29.835131 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e0b82212-b64c-4d88-b0c0-da6ecd89c8c3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:29.843341 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e0b82212-b64c-4d88-b0c0-da6ecd89c8c3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.159796 Jul 27 07:50:29.843933 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 66/138] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:29 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:29.849347 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-de860901-e159-41bb-bdf7-f89c452861e9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:29.850039 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-de860901-e159-41bb-bdf7-f89c452861e9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:29.856304 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de860901-e159-41bb-bdf7-f89c452861e9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:29.856823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de860901-e159-41bb-bdf7-f89c452861e9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:29.857625 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de860901-e159-41bb-bdf7-f89c452861e9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:29.858016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de860901-e159-41bb-bdf7-f89c452861e9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:29.977903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0dddf4a8-bfee-424a-a96d-39864a0e0955 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:29.978525 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0dddf4a8-bfee-424a-a96d-39864a0e0955 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:29.984632 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0dddf4a8-bfee-424a-a96d-39864a0e0955 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:29.985076 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0dddf4a8-bfee-424a-a96d-39864a0e0955 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:29.985848 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0dddf4a8-bfee-424a-a96d-39864a0e0955 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:29.986279 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0dddf4a8-bfee-424a-a96d-39864a0e0955 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:30.006511 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-de860901-e159-41bb-bdf7-f89c452861e9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:30.015507 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-de860901-e159-41bb-bdf7-f89c452861e9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.171322 Jul 27 07:50:30.021009 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 73/139] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:29 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:30.133757 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0dddf4a8-bfee-424a-a96d-39864a0e0955 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:30.141799 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0dddf4a8-bfee-424a-a96d-39864a0e0955 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.167974 Jul 27 07:50:30.142476 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 67/140] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:29 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:30.261077 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8abf5cfb-d29f-4026-bbc7-02433116196d tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:30.261693 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8abf5cfb-d29f-4026-bbc7-02433116196d tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:30.282636 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8abf5cfb-d29f-4026-bbc7-02433116196d tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:30.283454 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8abf5cfb-d29f-4026-bbc7-02433116196d tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:30.284499 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8abf5cfb-d29f-4026-bbc7-02433116196d tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:30.285825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8abf5cfb-d29f-4026-bbc7-02433116196d tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:30.428063 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8abf5cfb-d29f-4026-bbc7-02433116196d tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:30.430164 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a9243aad-630f-4aca-8bc8-1b11711eba3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:30.430773 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a9243aad-630f-4aca-8bc8-1b11711eba3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:30.436900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a9243aad-630f-4aca-8bc8-1b11711eba3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:30.437346 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a9243aad-630f-4aca-8bc8-1b11711eba3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:30.437491 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8abf5cfb-d29f-4026-bbc7-02433116196d tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.180072 Jul 27 07:50:30.438148 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a9243aad-630f-4aca-8bc8-1b11711eba3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:30.438640 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a9243aad-630f-4aca-8bc8-1b11711eba3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:30.439948 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 74/141] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:30 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:30.586120 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a9243aad-630f-4aca-8bc8-1b11711eba3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:30.594606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a9243aad-630f-4aca-8bc8-1b11711eba3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:30.596247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a9243aad-630f-4aca-8bc8-1b11711eba3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:30.597964 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a9243aad-630f-4aca-8bc8-1b11711eba3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.172136 Jul 27 07:50:30.598620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 68/142] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:30 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:30.864480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-953eddf4-655b-4be1-a770-f3f0d4027c7a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:30.865116 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-953eddf4-655b-4be1-a770-f3f0d4027c7a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:30.871731 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-953eddf4-655b-4be1-a770-f3f0d4027c7a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:30.872232 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-953eddf4-655b-4be1-a770-f3f0d4027c7a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:30.873040 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-953eddf4-655b-4be1-a770-f3f0d4027c7a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:30.873482 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-953eddf4-655b-4be1-a770-f3f0d4027c7a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:31.013937 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-953eddf4-655b-4be1-a770-f3f0d4027c7a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:31.022045 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-953eddf4-655b-4be1-a770-f3f0d4027c7a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.161492 Jul 27 07:50:31.022608 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 75/143] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:30 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:31.037305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b7f113dc-d58c-481d-ad89-7314e68f169c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:31.038052 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b7f113dc-d58c-481d-ad89-7314e68f169c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:31.044955 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b7f113dc-d58c-481d-ad89-7314e68f169c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:31.045391 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b7f113dc-d58c-481d-ad89-7314e68f169c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:31.046177 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b7f113dc-d58c-481d-ad89-7314e68f169c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:31.046579 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b7f113dc-d58c-481d-ad89-7314e68f169c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:31.164015 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-99205f69-7fb3-4f54-bf94-3c2c24c2733b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:31.164733 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-99205f69-7fb3-4f54-bf94-3c2c24c2733b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:31.171749 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-99205f69-7fb3-4f54-bf94-3c2c24c2733b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:31.172305 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-99205f69-7fb3-4f54-bf94-3c2c24c2733b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:31.173152 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-99205f69-7fb3-4f54-bf94-3c2c24c2733b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:31.173594 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-99205f69-7fb3-4f54-bf94-3c2c24c2733b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:31.181467 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b7f113dc-d58c-481d-ad89-7314e68f169c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:31.192085 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b7f113dc-d58c-481d-ad89-7314e68f169c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.158544 Jul 27 07:50:31.192085 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 69/144] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:31 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:31.313902 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-99205f69-7fb3-4f54-bf94-3c2c24c2733b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:31.323150 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-99205f69-7fb3-4f54-bf94-3c2c24c2733b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.163020 Jul 27 07:50:31.324138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 76/145] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:31 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:31.438416 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-f5e02ea3-0c91-48ff-8210-4d033d4f59fd req-68a537d1-f6f6-4b9c-964d-eb06075d842b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f7e2e6-f10c-45e8-aacb-67a155d5da44", "name": "network-vif-plugged", "status": "completed", "tag": "37d19150-619f-49f8-903f-5e239b14816f"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:50:31.449313 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-f5e02ea3-0c91-48ff-8210-4d033d4f59fd req-68a537d1-f6f6-4b9c-964d-eb06075d842b service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:31.449767 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-f5e02ea3-0c91-48ff-8210-4d033d4f59fd req-68a537d1-f6f6-4b9c-964d-eb06075d842b service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:31.461455 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-55aed5b5-5c79-412f-91d8-36c3538fe336 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:31.462292 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-55aed5b5-5c79-412f-91d8-36c3538fe336 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:31.467008 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-f5e02ea3-0c91-48ff-8210-4d033d4f59fd req-68a537d1-f6f6-4b9c-964d-eb06075d842b service nova] Creating event network-vif-plugged:37d19150-619f-49f8-903f-5e239b14816f for instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 on hv-cinder-82549 Jul 27 07:50:31.469771 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55aed5b5-5c79-412f-91d8-36c3538fe336 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:31.470247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55aed5b5-5c79-412f-91d8-36c3538fe336 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:31.471056 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55aed5b5-5c79-412f-91d8-36c3538fe336 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:31.471495 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55aed5b5-5c79-412f-91d8-36c3538fe336 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:31.474218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-f5e02ea3-0c91-48ff-8210-4d033d4f59fd req-68a537d1-f6f6-4b9c-964d-eb06075d842b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041922 Jul 27 07:50:31.475047 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 70/146] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:50:31.621036 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-bbf39578-3eaa-4c37-a3c6-379cb64f23af tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:31.621797 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-bbf39578-3eaa-4c37-a3c6-379cb64f23af tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:31.633399 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bbf39578-3eaa-4c37-a3c6-379cb64f23af tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:31.634242 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bbf39578-3eaa-4c37-a3c6-379cb64f23af tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:31.635057 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bbf39578-3eaa-4c37-a3c6-379cb64f23af tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:31.635490 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bbf39578-3eaa-4c37-a3c6-379cb64f23af tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:31.642085 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-55aed5b5-5c79-412f-91d8-36c3538fe336 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:31.649881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-55aed5b5-5c79-412f-91d8-36c3538fe336 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.195910 Jul 27 07:50:31.650764 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 77/147] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:31 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:31.771741 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-bbf39578-3eaa-4c37-a3c6-379cb64f23af tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:31.779776 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-bbf39578-3eaa-4c37-a3c6-379cb64f23af tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:31.781334 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-bbf39578-3eaa-4c37-a3c6-379cb64f23af tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:31.782447 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-bbf39578-3eaa-4c37-a3c6-379cb64f23af tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.165921 Jul 27 07:50:31.783023 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 71/148] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:31 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:32.042920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-dca7839f-83f5-49bf-87d6-81f9307debff tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:32.043552 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-dca7839f-83f5-49bf-87d6-81f9307debff tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:32.049487 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dca7839f-83f5-49bf-87d6-81f9307debff tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:32.050528 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dca7839f-83f5-49bf-87d6-81f9307debff tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:32.051332 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dca7839f-83f5-49bf-87d6-81f9307debff tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:32.051762 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dca7839f-83f5-49bf-87d6-81f9307debff tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:32.179146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-dca7839f-83f5-49bf-87d6-81f9307debff tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:32.187651 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-dca7839f-83f5-49bf-87d6-81f9307debff tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.148353 Jul 27 07:50:32.188187 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 78/149] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:32 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:32.211773 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1ae353d0-9081-4c88-abe2-96b6efb0d3df tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:32.212381 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1ae353d0-9081-4c88-abe2-96b6efb0d3df tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:32.218372 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1ae353d0-9081-4c88-abe2-96b6efb0d3df tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:32.218814 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1ae353d0-9081-4c88-abe2-96b6efb0d3df tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:32.219603 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1ae353d0-9081-4c88-abe2-96b6efb0d3df tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:32.220033 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1ae353d0-9081-4c88-abe2-96b6efb0d3df tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:32.344796 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-bfc2b535-48e7-42b5-8fb9-5af091e21758 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:32.345314 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-bfc2b535-48e7-42b5-8fb9-5af091e21758 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:32.352273 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bfc2b535-48e7-42b5-8fb9-5af091e21758 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:32.352799 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bfc2b535-48e7-42b5-8fb9-5af091e21758 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:32.353478 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bfc2b535-48e7-42b5-8fb9-5af091e21758 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:32.353907 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bfc2b535-48e7-42b5-8fb9-5af091e21758 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:32.359271 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1ae353d0-9081-4c88-abe2-96b6efb0d3df tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:32.366597 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1ae353d0-9081-4c88-abe2-96b6efb0d3df tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.158594 Jul 27 07:50:32.367189 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 72/150] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:32 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:32.484777 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bfc2b535-48e7-42b5-8fb9-5af091e21758 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:32.492100 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-bfc2b535-48e7-42b5-8fb9-5af091e21758 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.151294 Jul 27 07:50:32.492664 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 79/151] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:32 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:32.671150 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-277159d7-2785-48be-9feb-27799e713d64 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:32.671797 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-277159d7-2785-48be-9feb-27799e713d64 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:32.677947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-277159d7-2785-48be-9feb-27799e713d64 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:32.678393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-277159d7-2785-48be-9feb-27799e713d64 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:32.679187 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-277159d7-2785-48be-9feb-27799e713d64 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:32.679654 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-277159d7-2785-48be-9feb-27799e713d64 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:32.804630 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0045cf5a-1081-4203-a85c-5ac98535a517 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:32.805243 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0045cf5a-1081-4203-a85c-5ac98535a517 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:32.811499 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0045cf5a-1081-4203-a85c-5ac98535a517 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:32.811974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0045cf5a-1081-4203-a85c-5ac98535a517 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:32.812747 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0045cf5a-1081-4203-a85c-5ac98535a517 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:32.813183 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0045cf5a-1081-4203-a85c-5ac98535a517 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:32.816144 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-277159d7-2785-48be-9feb-27799e713d64 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:32.823547 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-277159d7-2785-48be-9feb-27799e713d64 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.156185 Jul 27 07:50:32.824222 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 73/152] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:32 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:32.941231 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0045cf5a-1081-4203-a85c-5ac98535a517 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:32.949121 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0045cf5a-1081-4203-a85c-5ac98535a517 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:32.950649 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0045cf5a-1081-4203-a85c-5ac98535a517 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:32.951779 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0045cf5a-1081-4203-a85c-5ac98535a517 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.151064 Jul 27 07:50:32.952336 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 80/153] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:32 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:33.209680 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7b95579b-3ffc-4f69-aeda-e1fa834e89e7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:33.210207 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-7b95579b-3ffc-4f69-aeda-e1fa834e89e7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:33.216625 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7b95579b-3ffc-4f69-aeda-e1fa834e89e7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:33.217173 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7b95579b-3ffc-4f69-aeda-e1fa834e89e7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:33.217826 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7b95579b-3ffc-4f69-aeda-e1fa834e89e7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:33.218262 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7b95579b-3ffc-4f69-aeda-e1fa834e89e7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:33.351981 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7b95579b-3ffc-4f69-aeda-e1fa834e89e7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:33.359805 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7b95579b-3ffc-4f69-aeda-e1fa834e89e7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.154018 Jul 27 07:50:33.360365 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 74/154] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:33 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:33.386115 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2b3d9baa-f623-4918-bd1e-0dbdd076fc0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:33.386721 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2b3d9baa-f623-4918-bd1e-0dbdd076fc0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:33.392877 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2b3d9baa-f623-4918-bd1e-0dbdd076fc0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:33.393324 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2b3d9baa-f623-4918-bd1e-0dbdd076fc0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:33.394138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2b3d9baa-f623-4918-bd1e-0dbdd076fc0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:33.394573 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2b3d9baa-f623-4918-bd1e-0dbdd076fc0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:33.398565 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:33.511925 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1a956e81-00b5-49c2-b8e2-d22b42c5c07e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:33.512537 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1a956e81-00b5-49c2-b8e2-d22b42c5c07e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:33.518842 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1a956e81-00b5-49c2-b8e2-d22b42c5c07e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:33.519326 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1a956e81-00b5-49c2-b8e2-d22b42c5c07e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:33.520094 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1a956e81-00b5-49c2-b8e2-d22b42c5c07e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:33.520532 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1a956e81-00b5-49c2-b8e2-d22b42c5c07e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:33.523996 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2b3d9baa-f623-4918-bd1e-0dbdd076fc0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:33.531536 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2b3d9baa-f623-4918-bd1e-0dbdd076fc0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.149062 Jul 27 07:50:33.532023 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 81/155] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:33 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:33.651458 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1a956e81-00b5-49c2-b8e2-d22b42c5c07e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:33.659904 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1a956e81-00b5-49c2-b8e2-d22b42c5c07e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.151120 Jul 27 07:50:33.660472 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 75/156] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:33 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:33.844749 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b829bc27-a821-4ceb-b5f4-a5b188150714 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:33.845362 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b829bc27-a821-4ceb-b5f4-a5b188150714 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:33.852359 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b829bc27-a821-4ceb-b5f4-a5b188150714 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:33.852804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b829bc27-a821-4ceb-b5f4-a5b188150714 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:33.853568 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b829bc27-a821-4ceb-b5f4-a5b188150714 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:33.854003 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b829bc27-a821-4ceb-b5f4-a5b188150714 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:33.975517 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-73776db8-71ea-48a1-ac2e-0a0d42ef37cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:33.976122 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-73776db8-71ea-48a1-ac2e-0a0d42ef37cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:33.980650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b829bc27-a821-4ceb-b5f4-a5b188150714 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:33.982274 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-73776db8-71ea-48a1-ac2e-0a0d42ef37cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:33.982722 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-73776db8-71ea-48a1-ac2e-0a0d42ef37cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:33.983552 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-73776db8-71ea-48a1-ac2e-0a0d42ef37cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:33.983982 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-73776db8-71ea-48a1-ac2e-0a0d42ef37cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:33.988640 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b829bc27-a821-4ceb-b5f4-a5b188150714 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.147629 Jul 27 07:50:33.989314 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 82/157] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:33 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:34.109691 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-73776db8-71ea-48a1-ac2e-0a0d42ef37cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:34.117858 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-73776db8-71ea-48a1-ac2e-0a0d42ef37cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:34.119410 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-73776db8-71ea-48a1-ac2e-0a0d42ef37cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:34.120521 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-73776db8-71ea-48a1-ac2e-0a0d42ef37cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.149865 Jul 27 07:50:34.121081 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 76/158] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:33 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:34.382989 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d6f65746-5463-4061-ae99-aa99d0908f5c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:34.383603 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d6f65746-5463-4061-ae99-aa99d0908f5c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:34.389659 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d6f65746-5463-4061-ae99-aa99d0908f5c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:34.390208 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d6f65746-5463-4061-ae99-aa99d0908f5c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:34.390901 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d6f65746-5463-4061-ae99-aa99d0908f5c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:34.391352 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d6f65746-5463-4061-ae99-aa99d0908f5c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:34.517762 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d6f65746-5463-4061-ae99-aa99d0908f5c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:34.525310 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d6f65746-5463-4061-ae99-aa99d0908f5c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.146242 Jul 27 07:50:34.525879 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 83/159] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:34 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:34.555942 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-33cfd1bf-8058-4126-8c18-6eac91797c64 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:34.556550 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-33cfd1bf-8058-4126-8c18-6eac91797c64 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:34.562700 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-33cfd1bf-8058-4126-8c18-6eac91797c64 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:34.563364 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-33cfd1bf-8058-4126-8c18-6eac91797c64 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:34.563955 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-33cfd1bf-8058-4126-8c18-6eac91797c64 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:34.564393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-33cfd1bf-8058-4126-8c18-6eac91797c64 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:34.690199 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-854887b6-8389-4b40-ba4d-92d60ddbdd05 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:34.692145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-854887b6-8389-4b40-ba4d-92d60ddbdd05 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:34.698508 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-854887b6-8389-4b40-ba4d-92d60ddbdd05 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:34.698973 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-854887b6-8389-4b40-ba4d-92d60ddbdd05 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:34.699755 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-854887b6-8389-4b40-ba4d-92d60ddbdd05 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:34.700187 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-854887b6-8389-4b40-ba4d-92d60ddbdd05 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:34.708936 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-33cfd1bf-8058-4126-8c18-6eac91797c64 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:34.716795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-33cfd1bf-8058-4126-8c18-6eac91797c64 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.164965 Jul 27 07:50:34.717374 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 77/160] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:34 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:34.831755 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-854887b6-8389-4b40-ba4d-92d60ddbdd05 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:34.839208 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-854887b6-8389-4b40-ba4d-92d60ddbdd05 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.156558 Jul 27 07:50:34.839765 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 84/161] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:34 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:35.009441 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f96f686c-e394-449e-a6f9-feeb31ec19b9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:35.010002 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f96f686c-e394-449e-a6f9-feeb31ec19b9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:35.016034 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f96f686c-e394-449e-a6f9-feeb31ec19b9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:35.016485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f96f686c-e394-449e-a6f9-feeb31ec19b9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:35.017244 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f96f686c-e394-449e-a6f9-feeb31ec19b9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:35.017684 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f96f686c-e394-449e-a6f9-feeb31ec19b9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:35.143514 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-58689510-3291-4dfd-a5e4-b186551bbb53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:35.144156 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-58689510-3291-4dfd-a5e4-b186551bbb53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:35.144774 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f96f686c-e394-449e-a6f9-feeb31ec19b9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:35.150374 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-58689510-3291-4dfd-a5e4-b186551bbb53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:35.150822 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-58689510-3291-4dfd-a5e4-b186551bbb53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:35.151622 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-58689510-3291-4dfd-a5e4-b186551bbb53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:35.152055 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-58689510-3291-4dfd-a5e4-b186551bbb53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:35.152233 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f96f686c-e394-449e-a6f9-feeb31ec19b9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.146712 Jul 27 07:50:35.152801 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 78/162] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:35 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:35.283100 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-58689510-3291-4dfd-a5e4-b186551bbb53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:35.291684 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-58689510-3291-4dfd-a5e4-b186551bbb53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:35.293214 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-58689510-3291-4dfd-a5e4-b186551bbb53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:35.294313 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-58689510-3291-4dfd-a5e4-b186551bbb53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.155040 Jul 27 07:50:35.294872 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 85/163] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:35 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:35.545674 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-4293ee9f-4852-4c51-b8e7-55bd16dbb741 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:35.546224 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-4293ee9f-4852-4c51-b8e7-55bd16dbb741 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:35.552351 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4293ee9f-4852-4c51-b8e7-55bd16dbb741 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:35.552783 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4293ee9f-4852-4c51-b8e7-55bd16dbb741 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:35.553534 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4293ee9f-4852-4c51-b8e7-55bd16dbb741 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:35.553984 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4293ee9f-4852-4c51-b8e7-55bd16dbb741 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:35.683244 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-4293ee9f-4852-4c51-b8e7-55bd16dbb741 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:35.691367 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-4293ee9f-4852-4c51-b8e7-55bd16dbb741 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.149619 Jul 27 07:50:35.691944 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 79/164] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:35 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:35.738074 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7291345d-e9a9-42c9-b2cf-3de3c5f016a3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:35.738683 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7291345d-e9a9-42c9-b2cf-3de3c5f016a3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:35.744851 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7291345d-e9a9-42c9-b2cf-3de3c5f016a3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:35.745313 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7291345d-e9a9-42c9-b2cf-3de3c5f016a3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:35.746101 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7291345d-e9a9-42c9-b2cf-3de3c5f016a3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:35.746535 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7291345d-e9a9-42c9-b2cf-3de3c5f016a3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:35.860110 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-893e07ec-9558-41f9-a225-420b87de6a91 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:35.860718 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-893e07ec-9558-41f9-a225-420b87de6a91 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:35.866734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-893e07ec-9558-41f9-a225-420b87de6a91 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:35.867220 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-893e07ec-9558-41f9-a225-420b87de6a91 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:35.867986 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-893e07ec-9558-41f9-a225-420b87de6a91 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:35.868423 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-893e07ec-9558-41f9-a225-420b87de6a91 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:35.872590 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=100 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:35.876551 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7291345d-e9a9-42c9-b2cf-3de3c5f016a3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:35.884520 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7291345d-e9a9-42c9-b2cf-3de3c5f016a3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.150322 Jul 27 07:50:35.885296 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 86/165] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:35 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:36.006851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-893e07ec-9558-41f9-a225-420b87de6a91 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:36.017138 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-893e07ec-9558-41f9-a225-420b87de6a91 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.160758 Jul 27 07:50:36.017722 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 80/166] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:35 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:36.174049 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6729daf1-d47c-44f4-bd1a-1683c2d2606e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:36.174657 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6729daf1-d47c-44f4-bd1a-1683c2d2606e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:36.177600 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:36.181722 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6729daf1-d47c-44f4-bd1a-1683c2d2606e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:36.182167 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6729daf1-d47c-44f4-bd1a-1683c2d2606e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:36.182957 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6729daf1-d47c-44f4-bd1a-1683c2d2606e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:36.183391 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6729daf1-d47c-44f4-bd1a-1683c2d2606e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:36.316707 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2fde45c6-2138-447a-8cb7-66da170f584f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:36.316831 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6729daf1-d47c-44f4-bd1a-1683c2d2606e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:36.317461 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2fde45c6-2138-447a-8cb7-66da170f584f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:36.325603 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2fde45c6-2138-447a-8cb7-66da170f584f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:36.326414 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2fde45c6-2138-447a-8cb7-66da170f584f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:36.327237 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6729daf1-d47c-44f4-bd1a-1683c2d2606e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.157016 Jul 27 07:50:36.327894 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2fde45c6-2138-447a-8cb7-66da170f584f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:36.329184 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 87/167] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:36 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:36.329370 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2fde45c6-2138-447a-8cb7-66da170f584f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:36.458480 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2fde45c6-2138-447a-8cb7-66da170f584f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:36.466992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2fde45c6-2138-447a-8cb7-66da170f584f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:36.468511 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2fde45c6-2138-447a-8cb7-66da170f584f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:36.469624 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2fde45c6-2138-447a-8cb7-66da170f584f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.156919 Jul 27 07:50:36.470189 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 81/168] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:36 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:36.712616 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-65cf528d-aca6-45c4-b7d7-2bdffa1937aa tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:36.713261 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-65cf528d-aca6-45c4-b7d7-2bdffa1937aa tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:36.719393 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-65cf528d-aca6-45c4-b7d7-2bdffa1937aa tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:36.719846 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-65cf528d-aca6-45c4-b7d7-2bdffa1937aa tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:36.720613 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-65cf528d-aca6-45c4-b7d7-2bdffa1937aa tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:36.721051 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-65cf528d-aca6-45c4-b7d7-2bdffa1937aa tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:36.895697 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-65cf528d-aca6-45c4-b7d7-2bdffa1937aa tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:36.903982 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-65cf528d-aca6-45c4-b7d7-2bdffa1937aa tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.195162 Jul 27 07:50:36.904557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 88/169] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:36 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:36.906529 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e072f5d1-8cc4-4082-8692-194312de3333 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:36.907195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e072f5d1-8cc4-4082-8692-194312de3333 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:36.913553 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e072f5d1-8cc4-4082-8692-194312de3333 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:36.913942 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e072f5d1-8cc4-4082-8692-194312de3333 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:36.914740 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e072f5d1-8cc4-4082-8692-194312de3333 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:36.915487 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e072f5d1-8cc4-4082-8692-194312de3333 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:37.041548 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-cc255fe0-988b-4d20-8431-d4f0734b382c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:37.041874 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-cc255fe0-988b-4d20-8431-d4f0734b382c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:37.052593 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cc255fe0-988b-4d20-8431-d4f0734b382c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:37.053049 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cc255fe0-988b-4d20-8431-d4f0734b382c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:37.053899 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cc255fe0-988b-4d20-8431-d4f0734b382c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:37.054382 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cc255fe0-988b-4d20-8431-d4f0734b382c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:37.077180 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e072f5d1-8cc4-4082-8692-194312de3333 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:37.093526 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e072f5d1-8cc4-4082-8692-194312de3333 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.191234 Jul 27 07:50:37.094511 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 82/170] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:36 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:37.226135 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-cc255fe0-988b-4d20-8431-d4f0734b382c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:37.234017 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-cc255fe0-988b-4d20-8431-d4f0734b382c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.199199 Jul 27 07:50:37.234594 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 89/171] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:37 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:37.349780 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-6b77185e-7c92-4166-ab43-b4177f34ad16 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:37.350398 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-6b77185e-7c92-4166-ab43-b4177f34ad16 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:37.356572 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6b77185e-7c92-4166-ab43-b4177f34ad16 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:37.357020 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6b77185e-7c92-4166-ab43-b4177f34ad16 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:37.357791 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6b77185e-7c92-4166-ab43-b4177f34ad16 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:37.358261 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6b77185e-7c92-4166-ab43-b4177f34ad16 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:37.492711 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e2feb6ea-55d4-4395-b155-6b4cd2893115 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:37.493380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e2feb6ea-55d4-4395-b155-6b4cd2893115 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:37.499276 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e2feb6ea-55d4-4395-b155-6b4cd2893115 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:37.499730 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e2feb6ea-55d4-4395-b155-6b4cd2893115 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:37.500501 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e2feb6ea-55d4-4395-b155-6b4cd2893115 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:37.500937 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e2feb6ea-55d4-4395-b155-6b4cd2893115 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:37.546458 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-6b77185e-7c92-4166-ab43-b4177f34ad16 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:37.569108 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-6b77185e-7c92-4166-ab43-b4177f34ad16 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.223750 Jul 27 07:50:37.583140 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 83/172] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:37 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:37.676333 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e2feb6ea-55d4-4395-b155-6b4cd2893115 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:37.685241 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e2feb6ea-55d4-4395-b155-6b4cd2893115 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:37.687056 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e2feb6ea-55d4-4395-b155-6b4cd2893115 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:37.688160 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e2feb6ea-55d4-4395-b155-6b4cd2893115 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.199354 Jul 27 07:50:37.688720 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 90/173] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:37 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:37.930419 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-005a38f6-5fe5-44d1-99d2-f38cf3c818bc tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:37.930980 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-005a38f6-5fe5-44d1-99d2-f38cf3c818bc tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:37.937105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-005a38f6-5fe5-44d1-99d2-f38cf3c818bc tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:37.937558 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-005a38f6-5fe5-44d1-99d2-f38cf3c818bc tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:37.938329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-005a38f6-5fe5-44d1-99d2-f38cf3c818bc tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:37.938763 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-005a38f6-5fe5-44d1-99d2-f38cf3c818bc tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:38.081114 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-005a38f6-5fe5-44d1-99d2-f38cf3c818bc tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:38.088935 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-005a38f6-5fe5-44d1-99d2-f38cf3c818bc tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.162362 Jul 27 07:50:38.102740 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 84/174] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:37 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:38.114010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e9732302-8b03-490e-a3b7-8eb27afaf0a6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:38.114623 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e9732302-8b03-490e-a3b7-8eb27afaf0a6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:38.122705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e9732302-8b03-490e-a3b7-8eb27afaf0a6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:38.123179 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e9732302-8b03-490e-a3b7-8eb27afaf0a6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:38.124138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e9732302-8b03-490e-a3b7-8eb27afaf0a6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:38.124771 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e9732302-8b03-490e-a3b7-8eb27afaf0a6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:38.255646 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f1e0340f-f151-47b5-b9bb-2e2a90cd3abf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:38.257192 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f1e0340f-f151-47b5-b9bb-2e2a90cd3abf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:38.264607 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f1e0340f-f151-47b5-b9bb-2e2a90cd3abf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:38.265246 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f1e0340f-f151-47b5-b9bb-2e2a90cd3abf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:38.266133 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f1e0340f-f151-47b5-b9bb-2e2a90cd3abf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:38.266689 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f1e0340f-f151-47b5-b9bb-2e2a90cd3abf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:38.270667 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e9732302-8b03-490e-a3b7-8eb27afaf0a6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:38.279716 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e9732302-8b03-490e-a3b7-8eb27afaf0a6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.169799 Jul 27 07:50:38.280401 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 91/175] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:38 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:38.480102 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f1e0340f-f151-47b5-b9bb-2e2a90cd3abf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:38.488451 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f1e0340f-f151-47b5-b9bb-2e2a90cd3abf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.236694 Jul 27 07:50:38.489157 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 85/176] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:38 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:38.592127 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3b8c77d8-7880-4fe0-9fbf-55184cf78ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:38.592744 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3b8c77d8-7880-4fe0-9fbf-55184cf78ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:38.600275 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b8c77d8-7880-4fe0-9fbf-55184cf78ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:38.600725 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b8c77d8-7880-4fe0-9fbf-55184cf78ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:38.601533 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b8c77d8-7880-4fe0-9fbf-55184cf78ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:38.601937 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b8c77d8-7880-4fe0-9fbf-55184cf78ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:38.711725 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-17e645f0-a4e7-4ca3-a2f3-fd0ad13a3cfa tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:38.712659 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-17e645f0-a4e7-4ca3-a2f3-fd0ad13a3cfa tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:38.719252 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-17e645f0-a4e7-4ca3-a2f3-fd0ad13a3cfa tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:38.720007 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-17e645f0-a4e7-4ca3-a2f3-fd0ad13a3cfa tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:38.721005 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-17e645f0-a4e7-4ca3-a2f3-fd0ad13a3cfa tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:38.721711 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-17e645f0-a4e7-4ca3-a2f3-fd0ad13a3cfa tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:38.901709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3b8c77d8-7880-4fe0-9fbf-55184cf78ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:38.913732 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3b8c77d8-7880-4fe0-9fbf-55184cf78ddf tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.325428 Jul 27 07:50:38.917655 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 92/177] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:38 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:39.019056 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-d5f71ce8-20ea-4787-8e71-2f790ef5a162 req-6950b531-3772-403c-a423-fcc4696223e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6", "name": "network-vif-plugged", "status": "completed", "tag": "049be348-8604-49d4-9257-b55b2d5b98fd"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:50:39.034551 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-d5f71ce8-20ea-4787-8e71-2f790ef5a162 req-6950b531-3772-403c-a423-fcc4696223e4 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:39.035376 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-d5f71ce8-20ea-4787-8e71-2f790ef5a162 req-6950b531-3772-403c-a423-fcc4696223e4 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:39.048309 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-d5f71ce8-20ea-4787-8e71-2f790ef5a162 req-6950b531-3772-403c-a423-fcc4696223e4 service nova] Creating event network-vif-plugged:049be348-8604-49d4-9257-b55b2d5b98fd for instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 on hv-cinder-82549 Jul 27 07:50:39.055681 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-d5f71ce8-20ea-4787-8e71-2f790ef5a162 req-6950b531-3772-403c-a423-fcc4696223e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040208 Jul 27 07:50:39.057015 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 93/178] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:50:39.117870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-51afc889-b10f-486e-bbed-5fbdb6e13c2b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:39.119491 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-51afc889-b10f-486e-bbed-5fbdb6e13c2b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:39.133227 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-51afc889-b10f-486e-bbed-5fbdb6e13c2b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:39.133960 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-51afc889-b10f-486e-bbed-5fbdb6e13c2b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:39.134724 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-51afc889-b10f-486e-bbed-5fbdb6e13c2b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:39.135198 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-51afc889-b10f-486e-bbed-5fbdb6e13c2b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:39.285677 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-51afc889-b10f-486e-bbed-5fbdb6e13c2b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:39.293404 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-51afc889-b10f-486e-bbed-5fbdb6e13c2b tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1363 microversion: 2.1 time: 0.180480 Jul 27 07:50:39.293974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 94/179] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:39 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:39.304691 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3e15df31-12bd-4f67-b0a9-95a1cbda2a2d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:39.305520 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3e15df31-12bd-4f67-b0a9-95a1cbda2a2d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:39.311719 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3e15df31-12bd-4f67-b0a9-95a1cbda2a2d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:39.312166 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3e15df31-12bd-4f67-b0a9-95a1cbda2a2d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:39.313131 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-17e645f0-a4e7-4ca3-a2f3-fd0ad13a3cfa tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:39.313622 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3e15df31-12bd-4f67-b0a9-95a1cbda2a2d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:39.313622 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3e15df31-12bd-4f67-b0a9-95a1cbda2a2d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:39.322919 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-17e645f0-a4e7-4ca3-a2f3-fd0ad13a3cfa tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:39.324684 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-17e645f0-a4e7-4ca3-a2f3-fd0ad13a3cfa tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:39.326096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-17e645f0-a4e7-4ca3-a2f3-fd0ad13a3cfa tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.618245 Jul 27 07:50:39.327366 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 86/180] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:38 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:39.496068 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3e15df31-12bd-4f67-b0a9-95a1cbda2a2d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:39.505150 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3e15df31-12bd-4f67-b0a9-95a1cbda2a2d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.205378 Jul 27 07:50:39.505990 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 95/181] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:39 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:39.510157 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-65898ed9-d784-454e-b55a-c9cbffb3cec8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:39.511680 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-65898ed9-d784-454e-b55a-c9cbffb3cec8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:39.518232 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-65898ed9-d784-454e-b55a-c9cbffb3cec8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:39.519351 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-65898ed9-d784-454e-b55a-c9cbffb3cec8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:39.520423 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-65898ed9-d784-454e-b55a-c9cbffb3cec8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:39.520860 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-65898ed9-d784-454e-b55a-c9cbffb3cec8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:39.670502 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-65898ed9-d784-454e-b55a-c9cbffb3cec8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:39.677996 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-65898ed9-d784-454e-b55a-c9cbffb3cec8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.172410 Jul 27 07:50:39.678554 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 87/182] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:39 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:39.938007 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e3ff6b8e-e5f6-4237-946c-939f47baadcb tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:39.938627 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e3ff6b8e-e5f6-4237-946c-939f47baadcb tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:39.946576 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e3ff6b8e-e5f6-4237-946c-939f47baadcb tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:39.947417 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e3ff6b8e-e5f6-4237-946c-939f47baadcb tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:39.949215 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e3ff6b8e-e5f6-4237-946c-939f47baadcb tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:39.950159 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e3ff6b8e-e5f6-4237-946c-939f47baadcb tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:40.118430 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e3ff6b8e-e5f6-4237-946c-939f47baadcb tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:40.147468 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e3ff6b8e-e5f6-4237-946c-939f47baadcb tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.213620 Jul 27 07:50:40.155469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 96/183] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:39 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:40.314183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-fa0e241f-6239-4940-922b-2e0b1683307a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:40.314989 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-fa0e241f-6239-4940-922b-2e0b1683307a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:40.321133 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fa0e241f-6239-4940-922b-2e0b1683307a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:40.321573 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fa0e241f-6239-4940-922b-2e0b1683307a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:40.322334 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fa0e241f-6239-4940-922b-2e0b1683307a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:40.322765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fa0e241f-6239-4940-922b-2e0b1683307a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:40.350379 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6246abbd-79fb-46c5-ae64-dea26ec8fd95 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:40.351125 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6246abbd-79fb-46c5-ae64-dea26ec8fd95 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:40.359516 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6246abbd-79fb-46c5-ae64-dea26ec8fd95 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:40.360331 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6246abbd-79fb-46c5-ae64-dea26ec8fd95 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:40.361315 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6246abbd-79fb-46c5-ae64-dea26ec8fd95 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:40.361815 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6246abbd-79fb-46c5-ae64-dea26ec8fd95 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:40.540326 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6246abbd-79fb-46c5-ae64-dea26ec8fd95 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:40.550311 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6246abbd-79fb-46c5-ae64-dea26ec8fd95 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:40.552484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6246abbd-79fb-46c5-ae64-dea26ec8fd95 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:40.554170 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6246abbd-79fb-46c5-ae64-dea26ec8fd95 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.208859 Jul 27 07:50:40.554915 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 97/184] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:40 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:40.560013 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-808df92f-a20c-4916-8933-20f1995c3d68 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:40.560703 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-808df92f-a20c-4916-8933-20f1995c3d68 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:40.567077 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-808df92f-a20c-4916-8933-20f1995c3d68 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:40.567766 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-808df92f-a20c-4916-8933-20f1995c3d68 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:40.568738 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-808df92f-a20c-4916-8933-20f1995c3d68 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:40.569236 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-808df92f-a20c-4916-8933-20f1995c3d68 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:40.569611 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-fa0e241f-6239-4940-922b-2e0b1683307a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:40.585041 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-fa0e241f-6239-4940-922b-2e0b1683307a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1548 microversion: 2.1 time: 0.274877 Jul 27 07:50:40.585673 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 88/185] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:40 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1548 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:40.605292 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:40.608541 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-54f47b3e-d27c-4919-abc6-37c644d69e89 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:40.609139 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-54f47b3e-d27c-4919-abc6-37c644d69e89 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:40.617279 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-54f47b3e-d27c-4919-abc6-37c644d69e89 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:40.617725 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-54f47b3e-d27c-4919-abc6-37c644d69e89 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:40.618549 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-54f47b3e-d27c-4919-abc6-37c644d69e89 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:40.619072 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-54f47b3e-d27c-4919-abc6-37c644d69e89 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:40.757963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-54f47b3e-d27c-4919-abc6-37c644d69e89 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154659 Jul 27 07:50:40.759120 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 89/186] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Jul 27 07:50:40 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:50:40.764156 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-4d078eb2-f987-4676-a17b-f27d449dd7d4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:40.764768 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-4d078eb2-f987-4676-a17b-f27d449dd7d4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:40.774191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4d078eb2-f987-4676-a17b-f27d449dd7d4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:40.774991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4d078eb2-f987-4676-a17b-f27d449dd7d4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:40.776276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4d078eb2-f987-4676-a17b-f27d449dd7d4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:40.776936 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4d078eb2-f987-4676-a17b-f27d449dd7d4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:40.816571 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-808df92f-a20c-4916-8933-20f1995c3d68 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:40.826053 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-808df92f-a20c-4916-8933-20f1995c3d68 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.269892 Jul 27 07:50:40.826796 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 98/187] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:40 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:41.176921 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d694e34d-35d5-4560-b5ad-b811c3360764 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:41.177648 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d694e34d-35d5-4560-b5ad-b811c3360764 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:41.183712 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d694e34d-35d5-4560-b5ad-b811c3360764 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:41.184181 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d694e34d-35d5-4560-b5ad-b811c3360764 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:41.184932 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d694e34d-35d5-4560-b5ad-b811c3360764 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:41.185362 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d694e34d-35d5-4560-b5ad-b811c3360764 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:41.260501 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-4d078eb2-f987-4676-a17b-f27d449dd7d4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:41.270659 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-4d078eb2-f987-4676-a17b-f27d449dd7d4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.510322 Jul 27 07:50:41.271542 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 90/188] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:40 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:41.334324 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d694e34d-35d5-4560-b5ad-b811c3360764 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:41.341836 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d694e34d-35d5-4560-b5ad-b811c3360764 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.168932 Jul 27 07:50:41.342398 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 99/189] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:41 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:41.576922 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9f81c4ce-f44c-4881-9051-6851b26a7e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:41.577943 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-9f81c4ce-f44c-4881-9051-6851b26a7e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:41.584202 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9f81c4ce-f44c-4881-9051-6851b26a7e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:41.584574 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9f81c4ce-f44c-4881-9051-6851b26a7e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:41.585343 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9f81c4ce-f44c-4881-9051-6851b26a7e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:41.585943 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9f81c4ce-f44c-4881-9051-6851b26a7e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:41.860257 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5272836a-901b-4ca1-8a22-e2dee2e42391 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:41.860866 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5272836a-901b-4ca1-8a22-e2dee2e42391 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:41.867750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5272836a-901b-4ca1-8a22-e2dee2e42391 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:41.868199 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5272836a-901b-4ca1-8a22-e2dee2e42391 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:41.868981 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5272836a-901b-4ca1-8a22-e2dee2e42391 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:41.869412 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5272836a-901b-4ca1-8a22-e2dee2e42391 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:42.028990 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5272836a-901b-4ca1-8a22-e2dee2e42391 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:42.037869 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5272836a-901b-4ca1-8a22-e2dee2e42391 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.181729 Jul 27 07:50:42.038536 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 100/190] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:41 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:42.089243 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9f81c4ce-f44c-4881-9051-6851b26a7e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:42.098340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9f81c4ce-f44c-4881-9051-6851b26a7e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:42.100428 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9f81c4ce-f44c-4881-9051-6851b26a7e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:42.101714 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9f81c4ce-f44c-4881-9051-6851b26a7e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.528796 Jul 27 07:50:42.102583 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 91/191] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:41 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:42.291913 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-546b5ba2-0abd-443b-a2fe-ac53c7daf38f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:42.292515 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-546b5ba2-0abd-443b-a2fe-ac53c7daf38f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:42.298625 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-546b5ba2-0abd-443b-a2fe-ac53c7daf38f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:42.299093 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-546b5ba2-0abd-443b-a2fe-ac53c7daf38f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:42.300338 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-546b5ba2-0abd-443b-a2fe-ac53c7daf38f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:42.300767 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-546b5ba2-0abd-443b-a2fe-ac53c7daf38f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:42.363871 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-abb57ffb-db56-42ee-9338-6b6bbd5e10d7 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:42.364817 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-abb57ffb-db56-42ee-9338-6b6bbd5e10d7 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:42.371345 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-abb57ffb-db56-42ee-9338-6b6bbd5e10d7 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:42.371842 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-abb57ffb-db56-42ee-9338-6b6bbd5e10d7 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:42.372680 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-abb57ffb-db56-42ee-9338-6b6bbd5e10d7 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:42.373189 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-abb57ffb-db56-42ee-9338-6b6bbd5e10d7 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:42.440301 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-546b5ba2-0abd-443b-a2fe-ac53c7daf38f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:42.448103 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-546b5ba2-0abd-443b-a2fe-ac53c7daf38f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.159994 Jul 27 07:50:42.448679 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 101/192] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:42 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:42.566562 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-c78c2614-dcc7-455c-a50f-8556d9778a5e req-af4e0ec0-de46-4bcb-8910-d65073c5bdaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480abe1b-7355-48b3-928a-4b32cc678979", "tag": "25e0ce5d-89f2-4b0c-92d3-258760019eca"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:50:42.569756 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-abb57ffb-db56-42ee-9338-6b6bbd5e10d7 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:42.577492 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-abb57ffb-db56-42ee-9338-6b6bbd5e10d7 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.217903 Jul 27 07:50:42.579313 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 92/193] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:42 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:42.580187 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-c78c2614-dcc7-455c-a50f-8556d9778a5e req-af4e0ec0-de46-4bcb-8910-d65073c5bdaf service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:42.580675 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-c78c2614-dcc7-455c-a50f-8556d9778a5e req-af4e0ec0-de46-4bcb-8910-d65073c5bdaf service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:42.592268 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-c78c2614-dcc7-455c-a50f-8556d9778a5e req-af4e0ec0-de46-4bcb-8910-d65073c5bdaf service nova] Creating event network-changed:25e0ce5d-89f2-4b0c-92d3-258760019eca for instance 480abe1b-7355-48b3-928a-4b32cc678979 on hv-cinder-82549 Jul 27 07:50:42.598186 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-c78c2614-dcc7-455c-a50f-8556d9778a5e req-af4e0ec0-de46-4bcb-8910-d65073c5bdaf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050456 Jul 27 07:50:42.599399 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 102/194] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:50:43.060916 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-5cf5b884-acd0-4918-b410-6dbedc10b4a9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:43.061524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-5cf5b884-acd0-4918-b410-6dbedc10b4a9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:43.067617 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5cf5b884-acd0-4918-b410-6dbedc10b4a9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:43.068062 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5cf5b884-acd0-4918-b410-6dbedc10b4a9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:43.068830 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5cf5b884-acd0-4918-b410-6dbedc10b4a9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:43.069266 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5cf5b884-acd0-4918-b410-6dbedc10b4a9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:43.125191 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-678d6c49-f4af-4130-8486-d942ea731dd0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:43.125915 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-678d6c49-f4af-4130-8486-d942ea731dd0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:43.133410 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-678d6c49-f4af-4130-8486-d942ea731dd0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:43.134192 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-678d6c49-f4af-4130-8486-d942ea731dd0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:43.135181 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-678d6c49-f4af-4130-8486-d942ea731dd0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:43.135978 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-678d6c49-f4af-4130-8486-d942ea731dd0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:43.229994 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-5cf5b884-acd0-4918-b410-6dbedc10b4a9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:43.239601 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-5cf5b884-acd0-4918-b410-6dbedc10b4a9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.182481 Jul 27 07:50:43.253441 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 93/195] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:43 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:43.306212 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-678d6c49-f4af-4130-8486-d942ea731dd0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:43.316319 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-678d6c49-f4af-4130-8486-d942ea731dd0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:43.317841 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-678d6c49-f4af-4130-8486-d942ea731dd0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:43.319011 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-678d6c49-f4af-4130-8486-d942ea731dd0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.198070 Jul 27 07:50:43.319575 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 103/196] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:43 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:43.468921 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-dcd26b42-a2ab-4357-b1cf-c8a4fbd21693 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:43.469447 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-dcd26b42-a2ab-4357-b1cf-c8a4fbd21693 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:43.475998 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dcd26b42-a2ab-4357-b1cf-c8a4fbd21693 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:43.476450 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dcd26b42-a2ab-4357-b1cf-c8a4fbd21693 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:43.477225 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dcd26b42-a2ab-4357-b1cf-c8a4fbd21693 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:43.477672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dcd26b42-a2ab-4357-b1cf-c8a4fbd21693 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:43.599488 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-605b30f4-36cf-4ca5-813e-ab677f8302ea tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:43.600276 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-605b30f4-36cf-4ca5-813e-ab677f8302ea tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:43.606573 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-605b30f4-36cf-4ca5-813e-ab677f8302ea tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:43.607832 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-605b30f4-36cf-4ca5-813e-ab677f8302ea tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:43.609229 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-605b30f4-36cf-4ca5-813e-ab677f8302ea tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:43.609867 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-605b30f4-36cf-4ca5-813e-ab677f8302ea tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:43.614925 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-dcd26b42-a2ab-4357-b1cf-c8a4fbd21693 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:43.623013 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-dcd26b42-a2ab-4357-b1cf-c8a4fbd21693 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.157896 Jul 27 07:50:43.623838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 94/197] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:43 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:43.749295 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-605b30f4-36cf-4ca5-813e-ab677f8302ea tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:43.766496 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-605b30f4-36cf-4ca5-813e-ab677f8302ea tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.171091 Jul 27 07:50:43.767110 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 104/198] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:43 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:44.261982 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-85a40c53-b360-4b4a-b6d8-b93ffe73ac5e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:44.262688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-85a40c53-b360-4b4a-b6d8-b93ffe73ac5e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:44.270839 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-85a40c53-b360-4b4a-b6d8-b93ffe73ac5e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:44.271388 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-85a40c53-b360-4b4a-b6d8-b93ffe73ac5e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:44.272241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-85a40c53-b360-4b4a-b6d8-b93ffe73ac5e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:44.272742 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-85a40c53-b360-4b4a-b6d8-b93ffe73ac5e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:44.343513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f785ae50-00c5-4a9b-9b5b-ab29e822412c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:44.344165 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f785ae50-00c5-4a9b-9b5b-ab29e822412c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:44.350717 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f785ae50-00c5-4a9b-9b5b-ab29e822412c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:44.351355 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f785ae50-00c5-4a9b-9b5b-ab29e822412c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:44.352123 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f785ae50-00c5-4a9b-9b5b-ab29e822412c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:44.352547 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f785ae50-00c5-4a9b-9b5b-ab29e822412c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:44.411464 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-85a40c53-b360-4b4a-b6d8-b93ffe73ac5e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:44.419647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-85a40c53-b360-4b4a-b6d8-b93ffe73ac5e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.161877 Jul 27 07:50:44.420421 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 95/199] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:44 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:44.479307 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f785ae50-00c5-4a9b-9b5b-ab29e822412c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:44.487673 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f785ae50-00c5-4a9b-9b5b-ab29e822412c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:44.489201 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f785ae50-00c5-4a9b-9b5b-ab29e822412c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:44.490289 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f785ae50-00c5-4a9b-9b5b-ab29e822412c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.150831 Jul 27 07:50:44.490842 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 105/200] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:44 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:44.644480 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-3137ceb0-163c-453b-a02d-b8d6ce7c4c8f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:44.645065 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-3137ceb0-163c-453b-a02d-b8d6ce7c4c8f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:44.651157 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3137ceb0-163c-453b-a02d-b8d6ce7c4c8f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:44.651602 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3137ceb0-163c-453b-a02d-b8d6ce7c4c8f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:44.652378 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3137ceb0-163c-453b-a02d-b8d6ce7c4c8f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:44.652804 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3137ceb0-163c-453b-a02d-b8d6ce7c4c8f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:44.781103 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3137ceb0-163c-453b-a02d-b8d6ce7c4c8f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:44.788604 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c2b03127-4b8f-412d-b1ed-a5c4c30444af tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:44.789239 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c2b03127-4b8f-412d-b1ed-a5c4c30444af tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:44.790568 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-3137ceb0-163c-453b-a02d-b8d6ce7c4c8f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.149864 Jul 27 07:50:44.796068 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c2b03127-4b8f-412d-b1ed-a5c4c30444af tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:44.796713 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c2b03127-4b8f-412d-b1ed-a5c4c30444af tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:44.797583 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c2b03127-4b8f-412d-b1ed-a5c4c30444af tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:44.798121 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c2b03127-4b8f-412d-b1ed-a5c4c30444af tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:44.804653 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 96/201] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:44 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:44.932070 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c2b03127-4b8f-412d-b1ed-a5c4c30444af tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:44.939504 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c2b03127-4b8f-412d-b1ed-a5c4c30444af tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.156361 Jul 27 07:50:44.940091 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 106/202] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:44 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:45.442389 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a0dad322-a038-4687-8ebc-d273f4e49c0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:45.443042 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a0dad322-a038-4687-8ebc-d273f4e49c0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:45.449069 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a0dad322-a038-4687-8ebc-d273f4e49c0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:45.449518 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a0dad322-a038-4687-8ebc-d273f4e49c0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:45.450277 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a0dad322-a038-4687-8ebc-d273f4e49c0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:45.450712 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a0dad322-a038-4687-8ebc-d273f4e49c0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:45.454596 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=100 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:45.513371 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-83a170ee-2eaa-46f8-959e-6d2272be61b4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:45.513966 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-83a170ee-2eaa-46f8-959e-6d2272be61b4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:45.520637 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-83a170ee-2eaa-46f8-959e-6d2272be61b4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:45.521083 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-83a170ee-2eaa-46f8-959e-6d2272be61b4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:45.521858 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-83a170ee-2eaa-46f8-959e-6d2272be61b4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:45.522296 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-83a170ee-2eaa-46f8-959e-6d2272be61b4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:45.582318 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a0dad322-a038-4687-8ebc-d273f4e49c0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:45.589933 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a0dad322-a038-4687-8ebc-d273f4e49c0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.151816 Jul 27 07:50:45.590586 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 97/203] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:45 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:45.649679 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-83a170ee-2eaa-46f8-959e-6d2272be61b4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:45.657612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-83a170ee-2eaa-46f8-959e-6d2272be61b4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:45.659152 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-83a170ee-2eaa-46f8-959e-6d2272be61b4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:45.660244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-83a170ee-2eaa-46f8-959e-6d2272be61b4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.151018 Jul 27 07:50:45.660803 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 107/204] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:45 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:45.811946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c9b3ca33-ed6c-40b0-bc7e-a007550030aa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:45.812549 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c9b3ca33-ed6c-40b0-bc7e-a007550030aa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:45.819343 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c9b3ca33-ed6c-40b0-bc7e-a007550030aa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:45.819725 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c9b3ca33-ed6c-40b0-bc7e-a007550030aa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:45.820492 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c9b3ca33-ed6c-40b0-bc7e-a007550030aa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:45.820985 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c9b3ca33-ed6c-40b0-bc7e-a007550030aa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:45.953967 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c9b3ca33-ed6c-40b0-bc7e-a007550030aa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:45.960427 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-62428b0d-5b6e-4e4b-9382-241dfabdb98f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:45.961062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-62428b0d-5b6e-4e4b-9382-241dfabdb98f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:45.961694 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c9b3ca33-ed6c-40b0-bc7e-a007550030aa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.153670 Jul 27 07:50:45.962273 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 98/205] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:45 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:45.967116 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-62428b0d-5b6e-4e4b-9382-241dfabdb98f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:45.967592 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-62428b0d-5b6e-4e4b-9382-241dfabdb98f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:45.968367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-62428b0d-5b6e-4e4b-9382-241dfabdb98f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:45.968832 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-62428b0d-5b6e-4e4b-9382-241dfabdb98f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:46.097645 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-62428b0d-5b6e-4e4b-9382-241dfabdb98f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:46.110948 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-62428b0d-5b6e-4e4b-9382-241dfabdb98f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.153826 Jul 27 07:50:46.111604 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 108/206] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:45 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:46.611093 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b6e24807-9c87-4747-a7fc-625158bda46c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:46.611619 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b6e24807-9c87-4747-a7fc-625158bda46c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:46.617854 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b6e24807-9c87-4747-a7fc-625158bda46c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:46.618304 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b6e24807-9c87-4747-a7fc-625158bda46c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:46.619090 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b6e24807-9c87-4747-a7fc-625158bda46c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:46.619531 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b6e24807-9c87-4747-a7fc-625158bda46c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:46.681634 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f0b57c27-707e-4ee1-aaa9-9947ee590fd3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:46.682239 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f0b57c27-707e-4ee1-aaa9-9947ee590fd3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:46.688459 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0b57c27-707e-4ee1-aaa9-9947ee590fd3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:46.688900 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0b57c27-707e-4ee1-aaa9-9947ee590fd3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:46.689664 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0b57c27-707e-4ee1-aaa9-9947ee590fd3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:46.690091 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0b57c27-707e-4ee1-aaa9-9947ee590fd3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:46.752200 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b6e24807-9c87-4747-a7fc-625158bda46c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:46.759766 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b6e24807-9c87-4747-a7fc-625158bda46c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.152583 Jul 27 07:50:46.760370 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 99/207] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:46 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:46.817736 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f0b57c27-707e-4ee1-aaa9-9947ee590fd3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:46.825736 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f0b57c27-707e-4ee1-aaa9-9947ee590fd3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:46.827272 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f0b57c27-707e-4ee1-aaa9-9947ee590fd3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:46.828407 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f0b57c27-707e-4ee1-aaa9-9947ee590fd3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.150646 Jul 27 07:50:46.828955 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 109/208] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:46 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:46.982822 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e2666e05-24f8-4139-bd11-f24a3e6cd6a8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:46.983481 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e2666e05-24f8-4139-bd11-f24a3e6cd6a8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:46.990552 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e2666e05-24f8-4139-bd11-f24a3e6cd6a8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:46.991411 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e2666e05-24f8-4139-bd11-f24a3e6cd6a8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:46.992336 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e2666e05-24f8-4139-bd11-f24a3e6cd6a8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:46.992905 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e2666e05-24f8-4139-bd11-f24a3e6cd6a8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:47.120729 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e2666e05-24f8-4139-bd11-f24a3e6cd6a8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:47.128687 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e2666e05-24f8-4139-bd11-f24a3e6cd6a8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.150282 Jul 27 07:50:47.129254 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 100/209] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:46 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:47.134830 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4a1e4d0a-0720-4995-9675-d450e58ebf98 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:47.135451 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4a1e4d0a-0720-4995-9675-d450e58ebf98 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:47.141495 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4a1e4d0a-0720-4995-9675-d450e58ebf98 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:47.141870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4a1e4d0a-0720-4995-9675-d450e58ebf98 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:47.142646 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4a1e4d0a-0720-4995-9675-d450e58ebf98 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:47.143671 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4a1e4d0a-0720-4995-9675-d450e58ebf98 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:47.273719 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4a1e4d0a-0720-4995-9675-d450e58ebf98 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:47.281358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4a1e4d0a-0720-4995-9675-d450e58ebf98 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.150256 Jul 27 07:50:47.281928 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 110/210] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:47 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:47.781097 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d21d4d06-a4eb-4bee-a330-acf568110a4e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:47.781618 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d21d4d06-a4eb-4bee-a330-acf568110a4e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:47.788778 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d21d4d06-a4eb-4bee-a330-acf568110a4e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:47.789252 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d21d4d06-a4eb-4bee-a330-acf568110a4e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:47.790076 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d21d4d06-a4eb-4bee-a330-acf568110a4e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:47.791301 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d21d4d06-a4eb-4bee-a330-acf568110a4e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:47.851407 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1d9badcd-4c8f-40fe-9423-4b2b76099634 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:47.852016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1d9badcd-4c8f-40fe-9423-4b2b76099634 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:47.863499 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d9badcd-4c8f-40fe-9423-4b2b76099634 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:47.864032 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d9badcd-4c8f-40fe-9423-4b2b76099634 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:47.864803 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d9badcd-4c8f-40fe-9423-4b2b76099634 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:47.865242 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d9badcd-4c8f-40fe-9423-4b2b76099634 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:47.946312 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d21d4d06-a4eb-4bee-a330-acf568110a4e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:47.965672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d21d4d06-a4eb-4bee-a330-acf568110a4e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.187771 Jul 27 07:50:47.966711 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 101/211] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:47 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:48.008544 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1d9badcd-4c8f-40fe-9423-4b2b76099634 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:48.017620 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1d9badcd-4c8f-40fe-9423-4b2b76099634 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:48.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1d9badcd-4c8f-40fe-9423-4b2b76099634 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:48.020689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1d9badcd-4c8f-40fe-9423-4b2b76099634 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.173648 Jul 27 07:50:48.021321 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 111/212] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:47 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:48.149311 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0f5c4e2d-bdcd-40f8-99d4-1687505f9fec tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:48.149912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0f5c4e2d-bdcd-40f8-99d4-1687505f9fec tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:48.156674 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0f5c4e2d-bdcd-40f8-99d4-1687505f9fec tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:48.157113 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0f5c4e2d-bdcd-40f8-99d4-1687505f9fec tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:48.157867 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0f5c4e2d-bdcd-40f8-99d4-1687505f9fec tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:48.158288 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0f5c4e2d-bdcd-40f8-99d4-1687505f9fec tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:48.308155 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0f5c4e2d-bdcd-40f8-99d4-1687505f9fec tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:48.311753 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-422fbd6e-e8c9-492a-9730-36c2106bd486 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:48.312366 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-422fbd6e-e8c9-492a-9730-36c2106bd486 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:48.319118 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0f5c4e2d-bdcd-40f8-99d4-1687505f9fec tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.173336 Jul 27 07:50:48.319228 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-422fbd6e-e8c9-492a-9730-36c2106bd486 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:48.319626 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-422fbd6e-e8c9-492a-9730-36c2106bd486 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:48.323289 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-422fbd6e-e8c9-492a-9730-36c2106bd486 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:48.323654 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 102/213] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:48 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:48.323737 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-422fbd6e-e8c9-492a-9730-36c2106bd486 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:48.450094 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-422fbd6e-e8c9-492a-9730-36c2106bd486 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:48.457548 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-422fbd6e-e8c9-492a-9730-36c2106bd486 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.151318 Jul 27 07:50:48.458115 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 112/214] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:48 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:48.988056 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a08b0768-7791-4f83-88a2-81d9e99343c5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:48.988771 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a08b0768-7791-4f83-88a2-81d9e99343c5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:49.012020 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a08b0768-7791-4f83-88a2-81d9e99343c5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:49.012571 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a08b0768-7791-4f83-88a2-81d9e99343c5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:49.013440 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a08b0768-7791-4f83-88a2-81d9e99343c5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:49.014071 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a08b0768-7791-4f83-88a2-81d9e99343c5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:49.042243 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a14ed8b7-607b-469e-bdc3-24fa771feb9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:49.043170 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a14ed8b7-607b-469e-bdc3-24fa771feb9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:49.050539 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a14ed8b7-607b-469e-bdc3-24fa771feb9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:49.052838 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a14ed8b7-607b-469e-bdc3-24fa771feb9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:49.053997 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a14ed8b7-607b-469e-bdc3-24fa771feb9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:49.054589 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a14ed8b7-607b-469e-bdc3-24fa771feb9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:49.171486 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a08b0768-7791-4f83-88a2-81d9e99343c5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:49.180766 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a08b0768-7791-4f83-88a2-81d9e99343c5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.197848 Jul 27 07:50:49.181349 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 103/215] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:48 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:49.225610 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a14ed8b7-607b-469e-bdc3-24fa771feb9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:49.233799 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a14ed8b7-607b-469e-bdc3-24fa771feb9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:49.235555 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a14ed8b7-607b-469e-bdc3-24fa771feb9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:49.236665 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a14ed8b7-607b-469e-bdc3-24fa771feb9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.198344 Jul 27 07:50:49.237969 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 113/216] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:49 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:49.341325 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-385e062f-6419-47c7-80f6-16c480674ef8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:49.342319 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-385e062f-6419-47c7-80f6-16c480674ef8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:49.352897 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-385e062f-6419-47c7-80f6-16c480674ef8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:49.353780 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-385e062f-6419-47c7-80f6-16c480674ef8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:49.354532 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-385e062f-6419-47c7-80f6-16c480674ef8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:49.354840 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-385e062f-6419-47c7-80f6-16c480674ef8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:49.478576 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a7024221-eab5-4095-bbe1-76dd3c772546 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:49.479280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a7024221-eab5-4095-bbe1-76dd3c772546 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:49.487794 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a7024221-eab5-4095-bbe1-76dd3c772546 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:49.488243 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a7024221-eab5-4095-bbe1-76dd3c772546 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:49.489043 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a7024221-eab5-4095-bbe1-76dd3c772546 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:49.489468 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a7024221-eab5-4095-bbe1-76dd3c772546 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:49.517401 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-385e062f-6419-47c7-80f6-16c480674ef8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:49.527279 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-385e062f-6419-47c7-80f6-16c480674ef8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1322 microversion: 2.1 time: 0.189460 Jul 27 07:50:49.528156 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 104/217] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:49 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:49.643250 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a7024221-eab5-4095-bbe1-76dd3c772546 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:49.651911 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a7024221-eab5-4095-bbe1-76dd3c772546 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.177108 Jul 27 07:50:49.652482 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 114/218] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:49 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:50.202031 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f8d0c034-acb6-467f-9a60-c8fa8c65134b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:50.202684 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f8d0c034-acb6-467f-9a60-c8fa8c65134b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:50.209821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f8d0c034-acb6-467f-9a60-c8fa8c65134b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:50.210352 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f8d0c034-acb6-467f-9a60-c8fa8c65134b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:50.211251 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f8d0c034-acb6-467f-9a60-c8fa8c65134b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:50.211593 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f8d0c034-acb6-467f-9a60-c8fa8c65134b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:50.260762 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4d52a9d6-9e8e-4a03-9515-b256fd8eb961 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:50.262086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4d52a9d6-9e8e-4a03-9515-b256fd8eb961 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:50.282567 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4d52a9d6-9e8e-4a03-9515-b256fd8eb961 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:50.283042 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4d52a9d6-9e8e-4a03-9515-b256fd8eb961 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:50.284262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4d52a9d6-9e8e-4a03-9515-b256fd8eb961 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:50.284689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4d52a9d6-9e8e-4a03-9515-b256fd8eb961 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:50.402358 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f8d0c034-acb6-467f-9a60-c8fa8c65134b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:50.410386 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f8d0c034-acb6-467f-9a60-c8fa8c65134b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.212365 Jul 27 07:50:50.411086 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 105/219] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:50 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:50.441089 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4d52a9d6-9e8e-4a03-9515-b256fd8eb961 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:50.444735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:50.449947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4d52a9d6-9e8e-4a03-9515-b256fd8eb961 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:50.451495 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4d52a9d6-9e8e-4a03-9515-b256fd8eb961 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:50.452587 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4d52a9d6-9e8e-4a03-9515-b256fd8eb961 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.195790 Jul 27 07:50:50.453129 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 115/220] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:50 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:50.550384 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-4bf023e8-cdbd-4b98-8695-d0eb4413547a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:50.551019 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-4bf023e8-cdbd-4b98-8695-d0eb4413547a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:50.556896 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4bf023e8-cdbd-4b98-8695-d0eb4413547a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:50.557366 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4bf023e8-cdbd-4b98-8695-d0eb4413547a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:50.558089 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4bf023e8-cdbd-4b98-8695-d0eb4413547a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:50.558710 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4bf023e8-cdbd-4b98-8695-d0eb4413547a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:50.680361 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-dd78891a-7d92-4a5f-a050-fe110a40005e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:50.681146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-dd78891a-7d92-4a5f-a050-fe110a40005e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:50.688248 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dd78891a-7d92-4a5f-a050-fe110a40005e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:50.688831 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dd78891a-7d92-4a5f-a050-fe110a40005e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:50.689448 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dd78891a-7d92-4a5f-a050-fe110a40005e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:50.689925 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dd78891a-7d92-4a5f-a050-fe110a40005e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:50.691745 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-4bf023e8-cdbd-4b98-8695-d0eb4413547a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:50.699801 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-4bf023e8-cdbd-4b98-8695-d0eb4413547a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1517 microversion: 2.1 time: 0.153561 Jul 27 07:50:50.700371 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 106/221] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:50 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:50.720307 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e71e1a86-6991-4f73-a7fd-451309eb6a4a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:50:50.723097 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e71e1a86-6991-4f73-a7fd-451309eb6a4a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:50.729437 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e71e1a86-6991-4f73-a7fd-451309eb6a4a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:50.729877 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e71e1a86-6991-4f73-a7fd-451309eb6a4a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:50.730633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e71e1a86-6991-4f73-a7fd-451309eb6a4a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:50.731263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e71e1a86-6991-4f73-a7fd-451309eb6a4a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:50.754906 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.objects.instance [None req-e71e1a86-6991-4f73-a7fd-451309eb6a4a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lazy-loading 'flavor' on Instance uuid 257c6f7b-d45d-499a-ade2-0b3371d09360 {{(pid=117779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:50:50.860311 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-dd78891a-7d92-4a5f-a050-fe110a40005e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:50.869676 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-dd78891a-7d92-4a5f-a050-fe110a40005e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.200581 Jul 27 07:50:50.870392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 116/222] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:50 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:50.894664 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e71e1a86-6991-4f73-a7fd-451309eb6a4a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "POST /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360/action" status: 200 len: 32 microversion: 2.1 time: 0.177346 Jul 27 07:50:50.895711 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 107/223] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Jul 27 07:50:50 2022] POST /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 07:50:50.906175 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7361a244-010e-4379-b74d-097d26bb85ad tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:50.906778 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7361a244-010e-4379-b74d-097d26bb85ad tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:50.913461 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7361a244-010e-4379-b74d-097d26bb85ad tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:50.913914 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7361a244-010e-4379-b74d-097d26bb85ad tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:50.914672 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7361a244-010e-4379-b74d-097d26bb85ad tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:50.915130 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7361a244-010e-4379-b74d-097d26bb85ad tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:51.047543 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7361a244-010e-4379-b74d-097d26bb85ad tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:51.058288 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7361a244-010e-4379-b74d-097d26bb85ad tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.156232 Jul 27 07:50:51.058868 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 117/224] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:50 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:51.432816 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a923f05b-5a31-44d0-8be2-361a6aa2ca9d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:51.434606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a923f05b-5a31-44d0-8be2-361a6aa2ca9d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:51.443543 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a923f05b-5a31-44d0-8be2-361a6aa2ca9d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:51.444391 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a923f05b-5a31-44d0-8be2-361a6aa2ca9d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:51.445163 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a923f05b-5a31-44d0-8be2-361a6aa2ca9d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:51.445601 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a923f05b-5a31-44d0-8be2-361a6aa2ca9d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:51.484036 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-20512584-238d-48fd-ad1c-0112886fb6ef tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1072501964", "imageRef": "646bfb5d-ef25-404a-a432-35d4209840fd", "flavorRef": "452"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:50:51.538321 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.network.neutron [None req-20512584-238d-48fd-ad1c-0112886fb6ef tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] validate_networks() for None {{(pid=117780) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:50:51.579286 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a923f05b-5a31-44d0-8be2-361a6aa2ca9d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:51.587406 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a923f05b-5a31-44d0-8be2-361a6aa2ca9d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1367 microversion: 2.1 time: 0.158897 Jul 27 07:50:51.587980 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 108/225] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:51 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:51.592443 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9cc58c73-7df3-4f7d-b5ea-20f9a1827637 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:51.593210 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-9cc58c73-7df3-4f7d-b5ea-20f9a1827637 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:51.599739 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9cc58c73-7df3-4f7d-b5ea-20f9a1827637 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:51.600381 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9cc58c73-7df3-4f7d-b5ea-20f9a1827637 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:51.601302 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9cc58c73-7df3-4f7d-b5ea-20f9a1827637 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:51.601878 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9cc58c73-7df3-4f7d-b5ea-20f9a1827637 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:51.741666 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9cc58c73-7df3-4f7d-b5ea-20f9a1827637 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:51.750503 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9cc58c73-7df3-4f7d-b5ea-20f9a1827637 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:51.752142 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9cc58c73-7df3-4f7d-b5ea-20f9a1827637 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:51.754115 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9cc58c73-7df3-4f7d-b5ea-20f9a1827637 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.165172 Jul 27 07:50:51.754938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 109/226] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:51 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:51.892117 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1e548e2f-a3f7-406a-8818-b94f283f7627 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:51.892955 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1e548e2f-a3f7-406a-8818-b94f283f7627 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:51.896234 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=100 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:51.903923 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1e548e2f-a3f7-406a-8818-b94f283f7627 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:51.904523 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1e548e2f-a3f7-406a-8818-b94f283f7627 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:51.905741 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1e548e2f-a3f7-406a-8818-b94f283f7627 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:51.906338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1e548e2f-a3f7-406a-8818-b94f283f7627 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:52.052571 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-20512584-238d-48fd-ad1c-0112886fb6ef tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Flavor limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:50:52.053505 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-20512584-238d-48fd-ad1c-0112886fb6ef tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Image limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:50:52.054126 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-20512584-238d-48fd-ad1c-0112886fb6ef tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Flavor pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:50:52.055053 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-20512584-238d-48fd-ad1c-0112886fb6ef tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Image pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:50:52.055482 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-20512584-238d-48fd-ad1c-0112886fb6ef tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:50:52.058110 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1e548e2f-a3f7-406a-8818-b94f283f7627 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:52.066980 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1e548e2f-a3f7-406a-8818-b94f283f7627 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.179374 Jul 27 07:50:52.067760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 110/227] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:51 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:52.068337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-20512584-238d-48fd-ad1c-0112886fb6ef tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:52.068791 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-20512584-238d-48fd-ad1c-0112886fb6ef tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:52.069631 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-20512584-238d-48fd-ad1c-0112886fb6ef tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:52.070142 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-20512584-238d-48fd-ad1c-0112886fb6ef tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:52.083294 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-48252eed-c975-4c7f-8788-c142af26aea0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:52.084780 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-48252eed-c975-4c7f-8788-c142af26aea0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:52.091199 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-48252eed-c975-4c7f-8788-c142af26aea0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:52.091488 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-20512584-238d-48fd-ad1c-0112886fb6ef tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Getting quotas for project 885070b1ca554f888588bc0661b6e60e. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:50:52.091802 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-48252eed-c975-4c7f-8788-c142af26aea0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:52.092782 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-48252eed-c975-4c7f-8788-c142af26aea0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:52.093126 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-48252eed-c975-4c7f-8788-c142af26aea0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:52.095772 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-20512584-238d-48fd-ad1c-0112886fb6ef tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Getting quotas for user c15dd07d86ec45f8ab90abedf599201c and project 885070b1ca554f888588bc0661b6e60e. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:50:52.108515 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-20512584-238d-48fd-ad1c-0112886fb6ef tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Going to run 1 instances... {{(pid=117780) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:50:52.110764 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-20512584-238d-48fd-ad1c-0112886fb6ef tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='646bfb5d-ef25-404a-a432-35d4209840fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:50:52.167819 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-20512584-238d-48fd-ad1c-0112886fb6ef tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691469 Jul 27 07:50:52.168812 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 118/228] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 07:50:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 07:50:52.180196 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9c166403-38c7-40bc-ac3a-449f3d5a0fe0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:52.182097 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9c166403-38c7-40bc-ac3a-449f3d5a0fe0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:52.263508 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-48252eed-c975-4c7f-8788-c142af26aea0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:52.266061 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:52.278103 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9c166403-38c7-40bc-ac3a-449f3d5a0fe0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:52.281986 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-48252eed-c975-4c7f-8788-c142af26aea0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.205427 Jul 27 07:50:52.283297 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 111/229] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:52 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:52.285785 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9c166403-38c7-40bc-ac3a-449f3d5a0fe0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1215 microversion: 2.1 time: 0.110160 Jul 27 07:50:52.286341 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 119/230] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:52 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1215 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:52.608795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-494b0093-ddd1-415a-adc8-27cb53d52553 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:52.609480 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-494b0093-ddd1-415a-adc8-27cb53d52553 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:52.617571 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-494b0093-ddd1-415a-adc8-27cb53d52553 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:52.618017 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-494b0093-ddd1-415a-adc8-27cb53d52553 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:52.618783 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-494b0093-ddd1-415a-adc8-27cb53d52553 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:52.619235 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-494b0093-ddd1-415a-adc8-27cb53d52553 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:52.773032 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-494b0093-ddd1-415a-adc8-27cb53d52553 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:52.780533 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-33499a17-080d-4ef8-add5-81a6c4cc08f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:52.781365 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-494b0093-ddd1-415a-adc8-27cb53d52553 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1558 microversion: 2.1 time: 0.176640 Jul 27 07:50:52.782304 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 112/231] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:52 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:52.783592 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-33499a17-080d-4ef8-add5-81a6c4cc08f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:52.801970 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-33499a17-080d-4ef8-add5-81a6c4cc08f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:52.806482 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-33499a17-080d-4ef8-add5-81a6c4cc08f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:52.807388 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-33499a17-080d-4ef8-add5-81a6c4cc08f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:52.808206 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a3a11277-7d68-47d3-bb93-28a3ffbd3140 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:52.808959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-33499a17-080d-4ef8-add5-81a6c4cc08f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:52.809238 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a3a11277-7d68-47d3-bb93-28a3ffbd3140 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:52.819315 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a3a11277-7d68-47d3-bb93-28a3ffbd3140 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:52.819752 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a3a11277-7d68-47d3-bb93-28a3ffbd3140 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:52.820550 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a3a11277-7d68-47d3-bb93-28a3ffbd3140 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:52.821037 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a3a11277-7d68-47d3-bb93-28a3ffbd3140 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:52.918142 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a3a11277-7d68-47d3-bb93-28a3ffbd3140 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116438 Jul 27 07:50:52.919086 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 113/232] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Jul 27 07:50:52 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:50:52.959164 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-33499a17-080d-4ef8-add5-81a6c4cc08f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:52.968157 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-33499a17-080d-4ef8-add5-81a6c4cc08f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:52.969804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-33499a17-080d-4ef8-add5-81a6c4cc08f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:52.971594 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-33499a17-080d-4ef8-add5-81a6c4cc08f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.197237 Jul 27 07:50:52.972238 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 120/233] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:52 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:53.087383 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2c8aad81-21c9-4bf5-8aae-fca4eefb19c7 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:53.088159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2c8aad81-21c9-4bf5-8aae-fca4eefb19c7 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:53.094611 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2c8aad81-21c9-4bf5-8aae-fca4eefb19c7 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:53.095429 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2c8aad81-21c9-4bf5-8aae-fca4eefb19c7 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:53.096811 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2c8aad81-21c9-4bf5-8aae-fca4eefb19c7 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:53.097327 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2c8aad81-21c9-4bf5-8aae-fca4eefb19c7 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:53.302960 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-db10bb46-416b-41ff-8eb9-0c0444845d7a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:53.303785 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-db10bb46-416b-41ff-8eb9-0c0444845d7a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:53.311484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-db10bb46-416b-41ff-8eb9-0c0444845d7a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:53.312436 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-db10bb46-416b-41ff-8eb9-0c0444845d7a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:53.313493 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-db10bb46-416b-41ff-8eb9-0c0444845d7a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:53.314271 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-db10bb46-416b-41ff-8eb9-0c0444845d7a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:53.350552 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2c8aad81-21c9-4bf5-8aae-fca4eefb19c7 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:53.363490 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2c8aad81-21c9-4bf5-8aae-fca4eefb19c7 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.279701 Jul 27 07:50:53.364604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 114/234] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:53 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:53.369508 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9960b0e1-ff65-4ae2-a2f2-e64a1280bea5 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:53.370328 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-9960b0e1-ff65-4ae2-a2f2-e64a1280bea5 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:53.388996 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9960b0e1-ff65-4ae2-a2f2-e64a1280bea5 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:53.390957 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9960b0e1-ff65-4ae2-a2f2-e64a1280bea5 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:53.393530 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9960b0e1-ff65-4ae2-a2f2-e64a1280bea5 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:53.394145 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9960b0e1-ff65-4ae2-a2f2-e64a1280bea5 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:53.524609 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-db10bb46-416b-41ff-8eb9-0c0444845d7a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:53.538482 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-db10bb46-416b-41ff-8eb9-0c0444845d7a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.239096 Jul 27 07:50:53.540686 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 121/235] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:53 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:53.541508 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9960b0e1-ff65-4ae2-a2f2-e64a1280bea5 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:53.553458 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9960b0e1-ff65-4ae2-a2f2-e64a1280bea5 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1219 microversion: 2.1 time: 0.187570 Jul 27 07:50:53.554624 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 115/236] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:53 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1219 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:53.617178 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-c5496fc1-1d4e-4e15-8cd4-7062cb084ba4 req-937d5d3c-871b-4423-8a22-04f4352fd1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "880126db-79f5-4c11-a0b5-85a612a1662a", "name": "network-vif-plugged", "status": "completed", "tag": "4acbfc37-e1fc-4b8f-a717-ec89154e30e4"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:50:53.631566 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-c5496fc1-1d4e-4e15-8cd4-7062cb084ba4 req-937d5d3c-871b-4423-8a22-04f4352fd1c1 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:53.632866 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-c5496fc1-1d4e-4e15-8cd4-7062cb084ba4 req-937d5d3c-871b-4423-8a22-04f4352fd1c1 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:53.644779 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-c5496fc1-1d4e-4e15-8cd4-7062cb084ba4 req-937d5d3c-871b-4423-8a22-04f4352fd1c1 service nova] Creating event network-vif-plugged:4acbfc37-e1fc-4b8f-a717-ec89154e30e4 for instance 880126db-79f5-4c11-a0b5-85a612a1662a on hv-cinder-82549 Jul 27 07:50:53.649897 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-c5496fc1-1d4e-4e15-8cd4-7062cb084ba4 req-937d5d3c-871b-4423-8a22-04f4352fd1c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036474 Jul 27 07:50:53.651075 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 122/237] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:50:53.997310 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ec3135e8-9be9-468d-aced-850de1b753dd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:53.997905 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ec3135e8-9be9-468d-aced-850de1b753dd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:54.006106 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ec3135e8-9be9-468d-aced-850de1b753dd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:54.006544 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ec3135e8-9be9-468d-aced-850de1b753dd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:54.007337 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ec3135e8-9be9-468d-aced-850de1b753dd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:54.007764 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ec3135e8-9be9-468d-aced-850de1b753dd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:54.408154 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-52f2f15e-918f-4b78-b608-12acb617318f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:54.422232 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-52f2f15e-918f-4b78-b608-12acb617318f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:54.438621 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-52f2f15e-918f-4b78-b608-12acb617318f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:54.442136 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-52f2f15e-918f-4b78-b608-12acb617318f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:54.443204 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-52f2f15e-918f-4b78-b608-12acb617318f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:54.443658 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-52f2f15e-918f-4b78-b608-12acb617318f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:54.453243 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ec3135e8-9be9-468d-aced-850de1b753dd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:54.461715 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ec3135e8-9be9-468d-aced-850de1b753dd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:54.466245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ec3135e8-9be9-468d-aced-850de1b753dd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:54.469813 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ec3135e8-9be9-468d-aced-850de1b753dd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.477859 Jul 27 07:50:54.475095 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 116/238] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:53 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:54.490998 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-0c298fe1-4d6f-4cd0-bdf2-bf030b4e92ef req-e95b66ea-9062-461a-b7d6-485ad90d9dac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6", "tag": "049be348-8604-49d4-9257-b55b2d5b98fd"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:50:54.504386 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-0c298fe1-4d6f-4cd0-bdf2-bf030b4e92ef req-e95b66ea-9062-461a-b7d6-485ad90d9dac service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:54.505473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-0c298fe1-4d6f-4cd0-bdf2-bf030b4e92ef req-e95b66ea-9062-461a-b7d6-485ad90d9dac service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:54.521481 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-0c298fe1-4d6f-4cd0-bdf2-bf030b4e92ef req-e95b66ea-9062-461a-b7d6-485ad90d9dac service nova] Creating event network-changed:049be348-8604-49d4-9257-b55b2d5b98fd for instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 on hv-cinder-82549 Jul 27 07:50:54.528171 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-0c298fe1-4d6f-4cd0-bdf2-bf030b4e92ef req-e95b66ea-9062-461a-b7d6-485ad90d9dac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047535 Jul 27 07:50:54.529235 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 117/239] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:50:54.561034 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-26eee584-3b5e-4aa9-bfca-82056d070b7a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:54.561916 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-26eee584-3b5e-4aa9-bfca-82056d070b7a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:54.570164 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-26eee584-3b5e-4aa9-bfca-82056d070b7a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:54.570847 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-26eee584-3b5e-4aa9-bfca-82056d070b7a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:54.571838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-26eee584-3b5e-4aa9-bfca-82056d070b7a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:54.572278 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-26eee584-3b5e-4aa9-bfca-82056d070b7a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:54.625359 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-52f2f15e-918f-4b78-b608-12acb617318f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:54.633040 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-52f2f15e-918f-4b78-b608-12acb617318f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1314 microversion: 2.1 time: 0.247728 Jul 27 07:50:54.635437 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 123/240] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:54 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:54.640920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-04307cd4-09d9-4422-b950-8b1fffb53958 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:54.641841 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-04307cd4-09d9-4422-b950-8b1fffb53958 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:54.649383 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-04307cd4-09d9-4422-b950-8b1fffb53958 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:54.650138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-04307cd4-09d9-4422-b950-8b1fffb53958 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:54.650595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-04307cd4-09d9-4422-b950-8b1fffb53958 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:54.651054 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-04307cd4-09d9-4422-b950-8b1fffb53958 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:54.711084 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-04307cd4-09d9-4422-b950-8b1fffb53958 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:54.719244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-04307cd4-09d9-4422-b950-8b1fffb53958 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1211 microversion: 2.1 time: 0.082477 Jul 27 07:50:54.719826 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 124/241] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:54 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:54.727335 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-26eee584-3b5e-4aa9-bfca-82056d070b7a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:54.734980 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-26eee584-3b5e-4aa9-bfca-82056d070b7a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.178214 Jul 27 07:50:54.735548 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 118/242] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:54 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:55.498280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-73421092-996e-4291-9fc6-30528255a6c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:55.499534 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-73421092-996e-4291-9fc6-30528255a6c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:55.506338 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-73421092-996e-4291-9fc6-30528255a6c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:55.506822 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-73421092-996e-4291-9fc6-30528255a6c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:55.508084 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-73421092-996e-4291-9fc6-30528255a6c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:55.509032 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-73421092-996e-4291-9fc6-30528255a6c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:55.655222 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0b965802-c38e-4bbd-9985-56dccd313452 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:55.656675 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0b965802-c38e-4bbd-9985-56dccd313452 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:55.668864 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0b965802-c38e-4bbd-9985-56dccd313452 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:55.669549 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0b965802-c38e-4bbd-9985-56dccd313452 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:55.670730 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0b965802-c38e-4bbd-9985-56dccd313452 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:55.671410 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0b965802-c38e-4bbd-9985-56dccd313452 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:55.712968 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-73421092-996e-4291-9fc6-30528255a6c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:55.724177 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-73421092-996e-4291-9fc6-30528255a6c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:55.725610 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-73421092-996e-4291-9fc6-30528255a6c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:55.726986 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-73421092-996e-4291-9fc6-30528255a6c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.232639 Jul 27 07:50:55.735017 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 125/243] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:55 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:55.743833 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d439c003-0e83-4fd6-898c-25fdcb3f91cb tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:55.745015 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d439c003-0e83-4fd6-898c-25fdcb3f91cb tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:55.757971 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d439c003-0e83-4fd6-898c-25fdcb3f91cb tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:55.758720 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d439c003-0e83-4fd6-898c-25fdcb3f91cb tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:55.759651 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d439c003-0e83-4fd6-898c-25fdcb3f91cb tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:55.760160 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d439c003-0e83-4fd6-898c-25fdcb3f91cb tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:55.827661 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d439c003-0e83-4fd6-898c-25fdcb3f91cb tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:55.839791 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d439c003-0e83-4fd6-898c-25fdcb3f91cb tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1267 microversion: 2.1 time: 0.097129 Jul 27 07:50:55.840444 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 126/244] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:55 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1267 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:55.845405 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-55a0d33e-46b4-457f-a93b-c49cc79ccbf8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:55.846303 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-55a0d33e-46b4-457f-a93b-c49cc79ccbf8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:55.853101 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55a0d33e-46b4-457f-a93b-c49cc79ccbf8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:55.853861 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55a0d33e-46b4-457f-a93b-c49cc79ccbf8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:55.854655 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55a0d33e-46b4-457f-a93b-c49cc79ccbf8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:55.855121 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55a0d33e-46b4-457f-a93b-c49cc79ccbf8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:55.860854 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0b965802-c38e-4bbd-9985-56dccd313452 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:55.869803 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0b965802-c38e-4bbd-9985-56dccd313452 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1501 microversion: 2.1 time: 0.218674 Jul 27 07:50:55.870679 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 119/245] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:55 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1501 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:56.009768 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-55a0d33e-46b4-457f-a93b-c49cc79ccbf8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:56.019104 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-55a0d33e-46b4-457f-a93b-c49cc79ccbf8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.177402 Jul 27 07:50:56.019687 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 127/246] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:55 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:56.750236 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-83255edf-2d2c-4d6a-aff5-0e68d70611ae tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:56.750795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-83255edf-2d2c-4d6a-aff5-0e68d70611ae tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:56.757774 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-83255edf-2d2c-4d6a-aff5-0e68d70611ae tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:56.758224 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-83255edf-2d2c-4d6a-aff5-0e68d70611ae tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:56.759065 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-83255edf-2d2c-4d6a-aff5-0e68d70611ae tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:56.759502 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-83255edf-2d2c-4d6a-aff5-0e68d70611ae tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:56.860788 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-70072234-baa7-453d-8c50-a872ce224ae9 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:56.861401 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-70072234-baa7-453d-8c50-a872ce224ae9 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:56.867372 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-70072234-baa7-453d-8c50-a872ce224ae9 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:56.867826 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-70072234-baa7-453d-8c50-a872ce224ae9 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:56.868593 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-70072234-baa7-453d-8c50-a872ce224ae9 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:56.869035 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-70072234-baa7-453d-8c50-a872ce224ae9 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:56.889591 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-83255edf-2d2c-4d6a-aff5-0e68d70611ae tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:56.900043 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-83255edf-2d2c-4d6a-aff5-0e68d70611ae tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:56.901769 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-83255edf-2d2c-4d6a-aff5-0e68d70611ae tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:56.903832 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-83255edf-2d2c-4d6a-aff5-0e68d70611ae tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.157563 Jul 27 07:50:56.904472 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 120/247] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:56 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:50:56.954846 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-70072234-baa7-453d-8c50-a872ce224ae9 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:56.963245 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-70072234-baa7-453d-8c50-a872ce224ae9 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1267 microversion: 2.1 time: 0.106218 Jul 27 07:50:56.964228 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 128/248] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:56 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1267 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:57.040963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e3c00f27-f40a-49fd-8b57-2b5d373075e3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:57.041955 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e3c00f27-f40a-49fd-8b57-2b5d373075e3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:57.049568 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e3c00f27-f40a-49fd-8b57-2b5d373075e3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:57.052363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e3c00f27-f40a-49fd-8b57-2b5d373075e3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:57.053380 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e3c00f27-f40a-49fd-8b57-2b5d373075e3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:57.054036 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e3c00f27-f40a-49fd-8b57-2b5d373075e3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:57.229457 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e3c00f27-f40a-49fd-8b57-2b5d373075e3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:57.237833 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e3c00f27-f40a-49fd-8b57-2b5d373075e3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.201827 Jul 27 07:50:57.238498 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 121/249] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:57 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:57.284150 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9b76eb1f-42f7-42b7-9c98-e238b0ce7d39 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7eee1541-b8f0-43e5-8094-85e133544570"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:50:57.286587 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9b76eb1f-42f7-42b7-9c98-e238b0ce7d39 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:57.289588 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:50:57.293891 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9b76eb1f-42f7-42b7-9c98-e238b0ce7d39 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:57.294265 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9b76eb1f-42f7-42b7-9c98-e238b0ce7d39 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:57.295092 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9b76eb1f-42f7-42b7-9c98-e238b0ce7d39 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:57.295520 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9b76eb1f-42f7-42b7-9c98-e238b0ce7d39 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:57.927201 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b2961abe-c905-4594-bbb1-50ee8f395633 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:57.927806 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b2961abe-c905-4594-bbb1-50ee8f395633 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:57.934117 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b2961abe-c905-4594-bbb1-50ee8f395633 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:57.934555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b2961abe-c905-4594-bbb1-50ee8f395633 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:57.935344 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b2961abe-c905-4594-bbb1-50ee8f395633 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:57.935771 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b2961abe-c905-4594-bbb1-50ee8f395633 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:58.197366 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b2961abe-c905-4594-bbb1-50ee8f395633 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:58.205549 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b2961abe-c905-4594-bbb1-50ee8f395633 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:58.207136 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b2961abe-c905-4594-bbb1-50ee8f395633 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:58.208251 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b2961abe-c905-4594-bbb1-50ee8f395633 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.285504 Jul 27 07:50:58.210876 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 122/250] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:57 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:58.213622 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-06981923-19af-4e6e-a904-563c3ce942f9 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:58.214234 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-06981923-19af-4e6e-a904-563c3ce942f9 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:58.220472 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-06981923-19af-4e6e-a904-563c3ce942f9 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:58.221418 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-06981923-19af-4e6e-a904-563c3ce942f9 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:58.222184 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-06981923-19af-4e6e-a904-563c3ce942f9 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:58.222624 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-06981923-19af-4e6e-a904-563c3ce942f9 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:58.285775 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-06981923-19af-4e6e-a904-563c3ce942f9 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:58.293530 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-06981923-19af-4e6e-a904-563c3ce942f9 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1273 microversion: 2.1 time: 0.083544 Jul 27 07:50:58.294099 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 123/251] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:58 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:58.298513 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1983221b-13de-42de-a615-60e905f4ed2c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:58.299670 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1983221b-13de-42de-a615-60e905f4ed2c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:58.305284 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1983221b-13de-42de-a615-60e905f4ed2c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:58.305722 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1983221b-13de-42de-a615-60e905f4ed2c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:58.306481 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1983221b-13de-42de-a615-60e905f4ed2c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:58.306926 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1983221b-13de-42de-a615-60e905f4ed2c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:58.439089 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1983221b-13de-42de-a615-60e905f4ed2c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:58.447026 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1983221b-13de-42de-a615-60e905f4ed2c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.151942 Jul 27 07:50:58.447604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 124/252] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:58 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:50:58.889372 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9b76eb1f-42f7-42b7-9c98-e238b0ce7d39 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "POST /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.609487 Jul 27 07:50:58.891044 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 129/253] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Jul 27 07:50:57 2022] POST /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44/os-volume_attachments => generated 194 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:50:59.231624 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-6c1a2aff-bbad-4835-806a-f7caf8f1666e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:59.232259 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-6c1a2aff-bbad-4835-806a-f7caf8f1666e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:59.239572 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6c1a2aff-bbad-4835-806a-f7caf8f1666e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:59.240012 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6c1a2aff-bbad-4835-806a-f7caf8f1666e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:59.240782 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6c1a2aff-bbad-4835-806a-f7caf8f1666e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:59.241203 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6c1a2aff-bbad-4835-806a-f7caf8f1666e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:59.317537 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e573a648-7304-42c4-baa4-a30ad1e601ca tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:59.318823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e573a648-7304-42c4-baa4-a30ad1e601ca tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:59.328263 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e573a648-7304-42c4-baa4-a30ad1e601ca tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:59.328704 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e573a648-7304-42c4-baa4-a30ad1e601ca tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:59.329472 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e573a648-7304-42c4-baa4-a30ad1e601ca tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:59.329905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e573a648-7304-42c4-baa4-a30ad1e601ca tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:59.395514 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e573a648-7304-42c4-baa4-a30ad1e601ca tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:59.409536 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e573a648-7304-42c4-baa4-a30ad1e601ca tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1273 microversion: 2.1 time: 0.097761 Jul 27 07:50:59.423628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 130/254] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:59 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:50:59.469053 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0bfc6fd0-51aa-4e82-a25c-012d25a469e5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:50:59.469803 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0bfc6fd0-51aa-4e82-a25c-012d25a469e5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:50:59.478334 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0bfc6fd0-51aa-4e82-a25c-012d25a469e5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:59.478978 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0bfc6fd0-51aa-4e82-a25c-012d25a469e5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:59.480133 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0bfc6fd0-51aa-4e82-a25c-012d25a469e5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:50:59.480750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0bfc6fd0-51aa-4e82-a25c-012d25a469e5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:50:59.486647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-6c1a2aff-bbad-4835-806a-f7caf8f1666e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:59.496955 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-6c1a2aff-bbad-4835-806a-f7caf8f1666e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:59.498655 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-6c1a2aff-bbad-4835-806a-f7caf8f1666e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:59.499954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-6c1a2aff-bbad-4835-806a-f7caf8f1666e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1407 microversion: 2.20 time: 0.272223 Jul 27 07:50:59.515531 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 125/255] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:50:59 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:50:59.651866 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0bfc6fd0-51aa-4e82-a25c-012d25a469e5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:50:59.660335 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0bfc6fd0-51aa-4e82-a25c-012d25a469e5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.194980 Jul 27 07:50:59.660834 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 131/256] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:50:59 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:00.439642 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-775ba613-49cf-4704-8b11-f7202d0a35a1 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:00.440362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-775ba613-49cf-4704-8b11-f7202d0a35a1 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:00.447282 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-775ba613-49cf-4704-8b11-f7202d0a35a1 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:00.447864 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-775ba613-49cf-4704-8b11-f7202d0a35a1 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:00.448767 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-775ba613-49cf-4704-8b11-f7202d0a35a1 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:00.449353 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-775ba613-49cf-4704-8b11-f7202d0a35a1 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:00.525613 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ea3a5654-538f-402a-bc83-41303d9e9956 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:00.526208 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ea3a5654-538f-402a-bc83-41303d9e9956 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:00.533339 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ea3a5654-538f-402a-bc83-41303d9e9956 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:00.533787 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ea3a5654-538f-402a-bc83-41303d9e9956 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:00.535099 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ea3a5654-538f-402a-bc83-41303d9e9956 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:00.535644 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ea3a5654-538f-402a-bc83-41303d9e9956 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:00.673889 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ea3a5654-538f-402a-bc83-41303d9e9956 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:00.683695 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ea3a5654-538f-402a-bc83-41303d9e9956 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:00.685130 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ea3a5654-538f-402a-bc83-41303d9e9956 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:00.686306 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ea3a5654-538f-402a-bc83-41303d9e9956 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1600 microversion: 2.20 time: 0.164948 Jul 27 07:51:00.686871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 132/257] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:51:00 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:51:00.691501 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3bc75abe-3bf2-4309-b563-896d4cce2747 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:00.692093 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3bc75abe-3bf2-4309-b563-896d4cce2747 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:00.698613 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3bc75abe-3bf2-4309-b563-896d4cce2747 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:00.699095 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3bc75abe-3bf2-4309-b563-896d4cce2747 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:00.699861 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3bc75abe-3bf2-4309-b563-896d4cce2747 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:00.700294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3bc75abe-3bf2-4309-b563-896d4cce2747 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:00.718776 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:00.841322 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3bc75abe-3bf2-4309-b563-896d4cce2747 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:00.851639 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3bc75abe-3bf2-4309-b563-896d4cce2747 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.163300 Jul 27 07:51:00.853006 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 133/258] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:00 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:00.858976 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-724609b9-1ffb-4ba7-8c52-bf866c9249d4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:00.859480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-724609b9-1ffb-4ba7-8c52-bf866c9249d4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:00.867263 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-724609b9-1ffb-4ba7-8c52-bf866c9249d4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:00.868331 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-724609b9-1ffb-4ba7-8c52-bf866c9249d4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:00.869120 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-724609b9-1ffb-4ba7-8c52-bf866c9249d4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:00.870368 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-724609b9-1ffb-4ba7-8c52-bf866c9249d4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:00.897677 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-775ba613-49cf-4704-8b11-f7202d0a35a1 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:00.905339 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-775ba613-49cf-4704-8b11-f7202d0a35a1 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1315 microversion: 2.1 time: 0.469607 Jul 27 07:51:00.905915 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 126/259] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:00 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:00.954812 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-724609b9-1ffb-4ba7-8c52-bf866c9249d4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100683 Jul 27 07:51:00.955466 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 134/260] 10.222.0.18 () {60 vars in 1316 bytes} [Wed Jul 27 07:51:00 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 07:51:01.258931 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-63f0f43e-7e7b-471a-a79c-fdea7e653445 req-fccba250-8157-4d68-8ba9-aa4abec16c4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98cc3d7e-e045-4893-a68c-20e44dd64485", "tag": "841cfe6a-3a35-4865-a8d2-462af786e66d"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:51:01.302382 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-63f0f43e-7e7b-471a-a79c-fdea7e653445 req-fccba250-8157-4d68-8ba9-aa4abec16c4d service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:01.303097 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-63f0f43e-7e7b-471a-a79c-fdea7e653445 req-fccba250-8157-4d68-8ba9-aa4abec16c4d service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:01.320301 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-63f0f43e-7e7b-471a-a79c-fdea7e653445 req-fccba250-8157-4d68-8ba9-aa4abec16c4d service nova] Creating event network-changed:841cfe6a-3a35-4865-a8d2-462af786e66d for instance 98cc3d7e-e045-4893-a68c-20e44dd64485 on hv-cinder-82549 Jul 27 07:51:01.327762 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-63f0f43e-7e7b-471a-a79c-fdea7e653445 req-fccba250-8157-4d68-8ba9-aa4abec16c4d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072955 Jul 27 07:51:01.328971 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 127/261] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:51:01.875511 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6de1c3ce-7ba5-47ca-be78-a6365f5e216b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:01.877068 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6de1c3ce-7ba5-47ca-be78-a6365f5e216b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:01.885503 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6de1c3ce-7ba5-47ca-be78-a6365f5e216b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:01.886298 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6de1c3ce-7ba5-47ca-be78-a6365f5e216b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:01.887253 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6de1c3ce-7ba5-47ca-be78-a6365f5e216b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:01.887703 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6de1c3ce-7ba5-47ca-be78-a6365f5e216b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:01.927759 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-681b4098-7e67-4ff9-a0a8-8d4b3f0c6b80 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:01.928547 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-681b4098-7e67-4ff9-a0a8-8d4b3f0c6b80 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:01.935228 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-681b4098-7e67-4ff9-a0a8-8d4b3f0c6b80 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:01.935794 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-681b4098-7e67-4ff9-a0a8-8d4b3f0c6b80 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:01.936651 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-681b4098-7e67-4ff9-a0a8-8d4b3f0c6b80 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:01.937154 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-681b4098-7e67-4ff9-a0a8-8d4b3f0c6b80 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:02.076018 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-681b4098-7e67-4ff9-a0a8-8d4b3f0c6b80 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:02.080110 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:02.085628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-681b4098-7e67-4ff9-a0a8-8d4b3f0c6b80 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1315 microversion: 2.1 time: 0.162178 Jul 27 07:51:02.086218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 128/262] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:01 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:02.196190 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6de1c3ce-7ba5-47ca-be78-a6365f5e216b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:02.206964 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6de1c3ce-7ba5-47ca-be78-a6365f5e216b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.334671 Jul 27 07:51:02.214247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 135/263] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:01 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:02.592416 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-3069f2cb-63d2-4e8b-90b9-d23e09bb3eff req-6ceb7baa-037f-4ac8-8389-8362da9e2e87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "880126db-79f5-4c11-a0b5-85a612a1662a", "tag": "4acbfc37-e1fc-4b8f-a717-ec89154e30e4"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:51:02.603008 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-3069f2cb-63d2-4e8b-90b9-d23e09bb3eff req-6ceb7baa-037f-4ac8-8389-8362da9e2e87 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:02.603455 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-3069f2cb-63d2-4e8b-90b9-d23e09bb3eff req-6ceb7baa-037f-4ac8-8389-8362da9e2e87 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:02.617771 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-3069f2cb-63d2-4e8b-90b9-d23e09bb3eff req-6ceb7baa-037f-4ac8-8389-8362da9e2e87 service nova] Creating event network-changed:4acbfc37-e1fc-4b8f-a717-ec89154e30e4 for instance 880126db-79f5-4c11-a0b5-85a612a1662a on hv-cinder-82549 Jul 27 07:51:02.623387 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-3069f2cb-63d2-4e8b-90b9-d23e09bb3eff req-6ceb7baa-037f-4ac8-8389-8362da9e2e87 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034601 Jul 27 07:51:02.624001 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 129/264] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:51:03.108170 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f1f2a016-70cb-4574-b6fc-49d22df378a2 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:03.108780 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f1f2a016-70cb-4574-b6fc-49d22df378a2 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:03.110645 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=8 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:03.116783 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f1f2a016-70cb-4574-b6fc-49d22df378a2 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:03.117235 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f1f2a016-70cb-4574-b6fc-49d22df378a2 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:03.118009 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f1f2a016-70cb-4574-b6fc-49d22df378a2 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:03.118441 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f1f2a016-70cb-4574-b6fc-49d22df378a2 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:03.231602 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ac0e1146-5e5c-4a8e-8f64-6d3681b695a2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:03.232231 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ac0e1146-5e5c-4a8e-8f64-6d3681b695a2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:03.240314 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ac0e1146-5e5c-4a8e-8f64-6d3681b695a2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:03.241387 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ac0e1146-5e5c-4a8e-8f64-6d3681b695a2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:03.242172 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ac0e1146-5e5c-4a8e-8f64-6d3681b695a2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:03.242608 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ac0e1146-5e5c-4a8e-8f64-6d3681b695a2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:03.276548 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f1f2a016-70cb-4574-b6fc-49d22df378a2 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:03.288326 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f1f2a016-70cb-4574-b6fc-49d22df378a2 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1315 microversion: 2.1 time: 0.184452 Jul 27 07:51:03.289145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 136/265] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:03 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:03.383910 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ac0e1146-5e5c-4a8e-8f64-6d3681b695a2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:03.386254 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=100 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:03.393100 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ac0e1146-5e5c-4a8e-8f64-6d3681b695a2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.167419 Jul 27 07:51:03.394230 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 130/266] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:03 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:04.309572 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d4d3151f-e34d-4ff6-a5be-3ade86793d4f tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:04.310286 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d4d3151f-e34d-4ff6-a5be-3ade86793d4f tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:04.317070 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d4d3151f-e34d-4ff6-a5be-3ade86793d4f tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:04.317512 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d4d3151f-e34d-4ff6-a5be-3ade86793d4f tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:04.318288 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d4d3151f-e34d-4ff6-a5be-3ade86793d4f tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:04.318716 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d4d3151f-e34d-4ff6-a5be-3ade86793d4f tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:04.414924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d2f02649-e450-401a-a21c-cb248bb4ee6e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:04.415627 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d2f02649-e450-401a-a21c-cb248bb4ee6e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:04.422531 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d2f02649-e450-401a-a21c-cb248bb4ee6e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:04.423106 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d2f02649-e450-401a-a21c-cb248bb4ee6e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:04.423958 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d2f02649-e450-401a-a21c-cb248bb4ee6e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:04.424616 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d2f02649-e450-401a-a21c-cb248bb4ee6e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:04.464277 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d4d3151f-e34d-4ff6-a5be-3ade86793d4f tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:04.472473 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d4d3151f-e34d-4ff6-a5be-3ade86793d4f tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1315 microversion: 2.1 time: 0.166939 Jul 27 07:51:04.473050 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 137/267] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:04 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:04.557031 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d2f02649-e450-401a-a21c-cb248bb4ee6e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:04.564992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d2f02649-e450-401a-a21c-cb248bb4ee6e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.153877 Jul 27 07:51:04.565566 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 131/268] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:04 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:05.494121 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-20e76ea5-3fb6-4b70-9b4d-fb27a5b883bf tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:05.494723 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-20e76ea5-3fb6-4b70-9b4d-fb27a5b883bf tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:05.501136 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-20e76ea5-3fb6-4b70-9b4d-fb27a5b883bf tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:05.501571 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-20e76ea5-3fb6-4b70-9b4d-fb27a5b883bf tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:05.502323 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-20e76ea5-3fb6-4b70-9b4d-fb27a5b883bf tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:05.503428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-20e76ea5-3fb6-4b70-9b4d-fb27a5b883bf tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:05.585863 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-bd4cc440-5d0e-4f42-8ab9-206427b144e0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:05.586697 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-bd4cc440-5d0e-4f42-8ab9-206427b144e0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:05.592865 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bd4cc440-5d0e-4f42-8ab9-206427b144e0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:05.593397 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bd4cc440-5d0e-4f42-8ab9-206427b144e0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:05.594239 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bd4cc440-5d0e-4f42-8ab9-206427b144e0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:05.594679 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bd4cc440-5d0e-4f42-8ab9-206427b144e0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:05.632829 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-20e76ea5-3fb6-4b70-9b4d-fb27a5b883bf tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:05.641251 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-20e76ea5-3fb6-4b70-9b4d-fb27a5b883bf tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1315 microversion: 2.1 time: 0.150789 Jul 27 07:51:05.642291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 138/269] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:05 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:05.726710 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-bd4cc440-5d0e-4f42-8ab9-206427b144e0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:05.734147 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-bd4cc440-5d0e-4f42-8ab9-206427b144e0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.152167 Jul 27 07:51:05.734708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 132/270] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:05 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:06.662789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-772d90f4-945b-4047-b185-dd06d9d2fcc0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:06.663334 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-772d90f4-945b-4047-b185-dd06d9d2fcc0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:06.669778 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-772d90f4-945b-4047-b185-dd06d9d2fcc0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:06.670216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-772d90f4-945b-4047-b185-dd06d9d2fcc0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:06.670999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-772d90f4-945b-4047-b185-dd06d9d2fcc0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:06.671430 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-772d90f4-945b-4047-b185-dd06d9d2fcc0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:06.755220 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-cc5b9daf-33e6-4119-ab36-dd74b5c23c26 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:06.755829 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-cc5b9daf-33e6-4119-ab36-dd74b5c23c26 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:06.761959 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cc5b9daf-33e6-4119-ab36-dd74b5c23c26 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:06.762429 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cc5b9daf-33e6-4119-ab36-dd74b5c23c26 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:06.763252 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cc5b9daf-33e6-4119-ab36-dd74b5c23c26 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:06.763721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cc5b9daf-33e6-4119-ab36-dd74b5c23c26 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:06.804771 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-772d90f4-945b-4047-b185-dd06d9d2fcc0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:06.812428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-772d90f4-945b-4047-b185-dd06d9d2fcc0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1315 microversion: 2.1 time: 0.153887 Jul 27 07:51:06.812998 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 139/271] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:06 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:06.901673 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-cc5b9daf-33e6-4119-ab36-dd74b5c23c26 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:06.909708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-cc5b9daf-33e6-4119-ab36-dd74b5c23c26 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.157707 Jul 27 07:51:06.910268 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 133/272] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:06 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:07.832357 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ec76b150-d0de-4857-9b66-9242b4b04f18 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:07.832978 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ec76b150-d0de-4857-9b66-9242b4b04f18 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:07.839727 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ec76b150-d0de-4857-9b66-9242b4b04f18 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:07.840051 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ec76b150-d0de-4857-9b66-9242b4b04f18 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:07.840816 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ec76b150-d0de-4857-9b66-9242b4b04f18 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:07.841261 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ec76b150-d0de-4857-9b66-9242b4b04f18 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:07.930233 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-44663217-592f-4b6d-bbce-e561258a9a36 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:07.930875 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-44663217-592f-4b6d-bbce-e561258a9a36 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:07.937075 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-44663217-592f-4b6d-bbce-e561258a9a36 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:07.937523 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-44663217-592f-4b6d-bbce-e561258a9a36 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:07.938291 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-44663217-592f-4b6d-bbce-e561258a9a36 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:07.938727 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-44663217-592f-4b6d-bbce-e561258a9a36 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:07.978917 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ec76b150-d0de-4857-9b66-9242b4b04f18 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:07.986431 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ec76b150-d0de-4857-9b66-9242b4b04f18 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1315 microversion: 2.1 time: 0.157913 Jul 27 07:51:07.987028 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 140/273] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:07 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:08.073719 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-44663217-592f-4b6d-bbce-e561258a9a36 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:08.081221 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-44663217-592f-4b6d-bbce-e561258a9a36 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.155492 Jul 27 07:51:08.082347 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 134/274] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:07 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:09.010360 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f32529a9-319f-42e4-9afa-ee4d1d6f8f65 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:09.011042 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f32529a9-319f-42e4-9afa-ee4d1d6f8f65 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:09.017783 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f32529a9-319f-42e4-9afa-ee4d1d6f8f65 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:09.018229 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f32529a9-319f-42e4-9afa-ee4d1d6f8f65 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:09.019116 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f32529a9-319f-42e4-9afa-ee4d1d6f8f65 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:09.019560 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f32529a9-319f-42e4-9afa-ee4d1d6f8f65 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:09.102483 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-8bd6a862-9ddc-4210-a082-ca4128b130a6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:09.103147 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-8bd6a862-9ddc-4210-a082-ca4128b130a6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:09.109472 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8bd6a862-9ddc-4210-a082-ca4128b130a6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:09.109906 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8bd6a862-9ddc-4210-a082-ca4128b130a6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:09.110670 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8bd6a862-9ddc-4210-a082-ca4128b130a6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:09.111271 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8bd6a862-9ddc-4210-a082-ca4128b130a6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:09.152218 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f32529a9-319f-42e4-9afa-ee4d1d6f8f65 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:09.160385 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f32529a9-319f-42e4-9afa-ee4d1d6f8f65 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1315 microversion: 2.1 time: 0.154633 Jul 27 07:51:09.161269 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 141/275] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:09 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:09.245185 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8bd6a862-9ddc-4210-a082-ca4128b130a6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:09.252780 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-8bd6a862-9ddc-4210-a082-ca4128b130a6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.154994 Jul 27 07:51:09.253996 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 135/276] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:09 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:10.180973 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c82fb88d-56b8-44e2-8b59-7d6243832486 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:10.181585 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c82fb88d-56b8-44e2-8b59-7d6243832486 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:10.188089 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c82fb88d-56b8-44e2-8b59-7d6243832486 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:10.188542 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c82fb88d-56b8-44e2-8b59-7d6243832486 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:10.189312 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c82fb88d-56b8-44e2-8b59-7d6243832486 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:10.189754 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c82fb88d-56b8-44e2-8b59-7d6243832486 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:10.274092 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-16516a5f-6db0-4417-897d-3992a598f3b4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:10.274671 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-16516a5f-6db0-4417-897d-3992a598f3b4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:10.280816 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-16516a5f-6db0-4417-897d-3992a598f3b4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:10.281262 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-16516a5f-6db0-4417-897d-3992a598f3b4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:10.282027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-16516a5f-6db0-4417-897d-3992a598f3b4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:10.282466 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-16516a5f-6db0-4417-897d-3992a598f3b4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:10.326426 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c82fb88d-56b8-44e2-8b59-7d6243832486 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:10.335030 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c82fb88d-56b8-44e2-8b59-7d6243832486 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1315 microversion: 2.1 time: 0.157844 Jul 27 07:51:10.335729 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 142/277] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:10 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:10.412454 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-16516a5f-6db0-4417-897d-3992a598f3b4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:10.419875 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-16516a5f-6db0-4417-897d-3992a598f3b4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.149649 Jul 27 07:51:10.420438 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 136/278] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:10 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:11.355916 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fdd2ebd5-e003-4a9a-b968-2c79da041532 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:11.356563 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fdd2ebd5-e003-4a9a-b968-2c79da041532 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:11.364177 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fdd2ebd5-e003-4a9a-b968-2c79da041532 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:11.364624 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fdd2ebd5-e003-4a9a-b968-2c79da041532 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:11.365389 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fdd2ebd5-e003-4a9a-b968-2c79da041532 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:11.365825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fdd2ebd5-e003-4a9a-b968-2c79da041532 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:11.440653 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e3e6133f-d18c-4baf-a30e-f786c73c01f8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:11.441946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e3e6133f-d18c-4baf-a30e-f786c73c01f8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:11.448102 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e3e6133f-d18c-4baf-a30e-f786c73c01f8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:11.448653 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e3e6133f-d18c-4baf-a30e-f786c73c01f8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:11.449305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e3e6133f-d18c-4baf-a30e-f786c73c01f8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:11.449734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e3e6133f-d18c-4baf-a30e-f786c73c01f8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:11.505288 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fdd2ebd5-e003-4a9a-b968-2c79da041532 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:11.514145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fdd2ebd5-e003-4a9a-b968-2c79da041532 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1315 microversion: 2.1 time: 0.162008 Jul 27 07:51:11.514804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 143/279] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:11 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:11.592471 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e3e6133f-d18c-4baf-a30e-f786c73c01f8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:11.600683 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e3e6133f-d18c-4baf-a30e-f786c73c01f8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.163898 Jul 27 07:51:11.601255 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 137/280] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:11 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:12.535001 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6692232a-9438-4eaf-80eb-7c8fb366d684 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:12.535630 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6692232a-9438-4eaf-80eb-7c8fb366d684 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:12.543374 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6692232a-9438-4eaf-80eb-7c8fb366d684 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:12.543827 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6692232a-9438-4eaf-80eb-7c8fb366d684 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:12.544601 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6692232a-9438-4eaf-80eb-7c8fb366d684 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:12.545039 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6692232a-9438-4eaf-80eb-7c8fb366d684 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:12.621892 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e4154937-723a-4419-93a3-b00d0a9afdfc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:12.622791 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e4154937-723a-4419-93a3-b00d0a9afdfc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:12.630197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e4154937-723a-4419-93a3-b00d0a9afdfc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:12.630734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e4154937-723a-4419-93a3-b00d0a9afdfc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:12.631629 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e4154937-723a-4419-93a3-b00d0a9afdfc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:12.632138 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e4154937-723a-4419-93a3-b00d0a9afdfc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:12.683743 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6692232a-9438-4eaf-80eb-7c8fb366d684 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:12.691806 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6692232a-9438-4eaf-80eb-7c8fb366d684 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1315 microversion: 2.1 time: 0.160626 Jul 27 07:51:12.692383 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 144/281] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:12 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:12.783892 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e4154937-723a-4419-93a3-b00d0a9afdfc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:12.791436 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e4154937-723a-4419-93a3-b00d0a9afdfc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.173507 Jul 27 07:51:12.792014 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 138/282] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:12 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:13.713067 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8b7900d8-af4d-4d57-81f2-5d0df1161a53 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:13.713720 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8b7900d8-af4d-4d57-81f2-5d0df1161a53 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:13.720353 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8b7900d8-af4d-4d57-81f2-5d0df1161a53 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:13.720802 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8b7900d8-af4d-4d57-81f2-5d0df1161a53 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:13.721566 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8b7900d8-af4d-4d57-81f2-5d0df1161a53 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:13.722568 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8b7900d8-af4d-4d57-81f2-5d0df1161a53 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:13.823037 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-5c812c13-0b69-459f-9c02-ce2da9095e0f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:13.823037 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-5c812c13-0b69-459f-9c02-ce2da9095e0f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:13.823037 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5c812c13-0b69-459f-9c02-ce2da9095e0f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:13.823037 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5c812c13-0b69-459f-9c02-ce2da9095e0f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:13.823784 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5c812c13-0b69-459f-9c02-ce2da9095e0f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:13.823784 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5c812c13-0b69-459f-9c02-ce2da9095e0f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:13.854794 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8b7900d8-af4d-4d57-81f2-5d0df1161a53 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:13.862383 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8b7900d8-af4d-4d57-81f2-5d0df1161a53 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1315 microversion: 2.1 time: 0.153108 Jul 27 07:51:13.863023 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 145/283] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:13 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:13.949275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-5c812c13-0b69-459f-9c02-ce2da9095e0f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:13.957404 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-5c812c13-0b69-459f-9c02-ce2da9095e0f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.147273 Jul 27 07:51:13.957976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 139/284] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:13 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:14.883281 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f05742c8-b39c-4bee-bc93-e0f3ba351852 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:14.883927 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f05742c8-b39c-4bee-bc93-e0f3ba351852 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:14.890500 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f05742c8-b39c-4bee-bc93-e0f3ba351852 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:14.890992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f05742c8-b39c-4bee-bc93-e0f3ba351852 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:14.891766 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f05742c8-b39c-4bee-bc93-e0f3ba351852 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:14.892202 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f05742c8-b39c-4bee-bc93-e0f3ba351852 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:14.978342 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-5a8120da-7199-4e7b-9b94-8d639531839e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:14.979187 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-5a8120da-7199-4e7b-9b94-8d639531839e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:14.985717 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5a8120da-7199-4e7b-9b94-8d639531839e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:14.986195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5a8120da-7199-4e7b-9b94-8d639531839e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:14.986990 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5a8120da-7199-4e7b-9b94-8d639531839e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:14.987429 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5a8120da-7199-4e7b-9b94-8d639531839e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:15.024738 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f05742c8-b39c-4bee-bc93-e0f3ba351852 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:15.032261 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f05742c8-b39c-4bee-bc93-e0f3ba351852 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1315 microversion: 2.1 time: 0.152763 Jul 27 07:51:15.032837 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 146/285] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:14 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:15.120838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-5a8120da-7199-4e7b-9b94-8d639531839e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:15.128646 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-5a8120da-7199-4e7b-9b94-8d639531839e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.154807 Jul 27 07:51:15.129218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 140/286] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:14 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:16.054481 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d114f147-f464-44df-9c9f-97d8d8fd1abd tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:16.055108 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d114f147-f464-44df-9c9f-97d8d8fd1abd tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:16.061549 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d114f147-f464-44df-9c9f-97d8d8fd1abd tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:16.061995 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d114f147-f464-44df-9c9f-97d8d8fd1abd tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:16.062779 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d114f147-f464-44df-9c9f-97d8d8fd1abd tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:16.063260 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d114f147-f464-44df-9c9f-97d8d8fd1abd tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:16.094842 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-2dd6754f-a25c-4a65-a271-131a1ce1c843 req-390bd945-aec2-4ad2-abe2-8de7102f26c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98cc3d7e-e045-4893-a68c-20e44dd64485", "name": "network-vif-plugged", "status": "completed", "tag": "841cfe6a-3a35-4865-a8d2-462af786e66d"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:51:16.107133 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-2dd6754f-a25c-4a65-a271-131a1ce1c843 req-390bd945-aec2-4ad2-abe2-8de7102f26c0 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:16.107975 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-2dd6754f-a25c-4a65-a271-131a1ce1c843 req-390bd945-aec2-4ad2-abe2-8de7102f26c0 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:16.121688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-2dd6754f-a25c-4a65-a271-131a1ce1c843 req-390bd945-aec2-4ad2-abe2-8de7102f26c0 service nova] Creating event network-vif-plugged:841cfe6a-3a35-4865-a8d2-462af786e66d for instance 98cc3d7e-e045-4893-a68c-20e44dd64485 on hv-cinder-82549 Jul 27 07:51:16.130512 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-2dd6754f-a25c-4a65-a271-131a1ce1c843 req-390bd945-aec2-4ad2-abe2-8de7102f26c0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040771 Jul 27 07:51:16.131843 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 141/287] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:51:16.154614 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f9b71850-6bf8-4a40-b978-e88e422562b0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:16.155617 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f9b71850-6bf8-4a40-b978-e88e422562b0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:16.173499 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f9b71850-6bf8-4a40-b978-e88e422562b0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:16.174383 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f9b71850-6bf8-4a40-b978-e88e422562b0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:16.175970 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f9b71850-6bf8-4a40-b978-e88e422562b0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:16.176588 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f9b71850-6bf8-4a40-b978-e88e422562b0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:16.217009 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d114f147-f464-44df-9c9f-97d8d8fd1abd tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:16.224819 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d114f147-f464-44df-9c9f-97d8d8fd1abd tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1315 microversion: 2.1 time: 0.175211 Jul 27 07:51:16.225389 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 147/288] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:16 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:16.490153 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f9b71850-6bf8-4a40-b978-e88e422562b0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:16.498331 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f9b71850-6bf8-4a40-b978-e88e422562b0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.350022 Jul 27 07:51:16.508196 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 142/289] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:16 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:17.064050 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0c614889-ca88-431b-bc15-fc4d62cfc695 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:17.064623 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0c614889-ca88-431b-bc15-fc4d62cfc695 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:17.071050 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0c614889-ca88-431b-bc15-fc4d62cfc695 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:17.071576 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0c614889-ca88-431b-bc15-fc4d62cfc695 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:17.072412 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0c614889-ca88-431b-bc15-fc4d62cfc695 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:17.072923 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0c614889-ca88-431b-bc15-fc4d62cfc695 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:17.097920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0c614889-ca88-431b-bc15-fc4d62cfc695 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 07:51:17.167785 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:17.211738 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0c614889-ca88-431b-bc15-fc4d62cfc695 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "DELETE /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 204 len: 0 microversion: 2.1 time: 0.151460 Jul 27 07:51:17.212631 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 148/290] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 07:51:17 2022] DELETE /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 07:51:17.222644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d96a30b9-a73f-4b7e-884d-20a8624c2cbc tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:17.223297 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d96a30b9-a73f-4b7e-884d-20a8624c2cbc tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:17.229533 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d96a30b9-a73f-4b7e-884d-20a8624c2cbc tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:17.229982 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d96a30b9-a73f-4b7e-884d-20a8624c2cbc tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:17.230750 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d96a30b9-a73f-4b7e-884d-20a8624c2cbc tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:17.231223 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d96a30b9-a73f-4b7e-884d-20a8624c2cbc tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:17.246813 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-78c4cfbb-42ed-49d6-ab23-44a3eae34c2e tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:17.247626 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-78c4cfbb-42ed-49d6-ab23-44a3eae34c2e tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:17.405075 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-78c4cfbb-42ed-49d6-ab23-44a3eae34c2e tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:17.405519 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-78c4cfbb-42ed-49d6-ab23-44a3eae34c2e tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:17.406310 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-78c4cfbb-42ed-49d6-ab23-44a3eae34c2e tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:17.406731 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-78c4cfbb-42ed-49d6-ab23-44a3eae34c2e tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:17.497833 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d96a30b9-a73f-4b7e-884d-20a8624c2cbc tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:17.508825 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d96a30b9-a73f-4b7e-884d-20a8624c2cbc tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1553 microversion: 2.1 time: 0.290783 Jul 27 07:51:17.523334 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 143/291] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:17 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1553 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:17.528769 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-35a995be-0b47-4362-9d54-9e0ff6b5057e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:17.529387 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-35a995be-0b47-4362-9d54-9e0ff6b5057e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:17.535895 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-35a995be-0b47-4362-9d54-9e0ff6b5057e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:17.536344 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-35a995be-0b47-4362-9d54-9e0ff6b5057e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:17.537252 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-35a995be-0b47-4362-9d54-9e0ff6b5057e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:17.537686 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-35a995be-0b47-4362-9d54-9e0ff6b5057e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:17.554073 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-78c4cfbb-42ed-49d6-ab23-44a3eae34c2e tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:17.563236 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-78c4cfbb-42ed-49d6-ab23-44a3eae34c2e tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1315 microversion: 2.1 time: 0.321006 Jul 27 07:51:17.563805 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 149/292] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:17 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:17.678620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-35a995be-0b47-4362-9d54-9e0ff6b5057e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:17.686801 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-35a995be-0b47-4362-9d54-9e0ff6b5057e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.161797 Jul 27 07:51:17.687412 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 144/293] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:17 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:18.529616 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e45250f8-6999-4cd7-b18c-3628fc3e09c0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:18.530498 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e45250f8-6999-4cd7-b18c-3628fc3e09c0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:18.537701 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e45250f8-6999-4cd7-b18c-3628fc3e09c0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:18.538153 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e45250f8-6999-4cd7-b18c-3628fc3e09c0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:18.538938 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e45250f8-6999-4cd7-b18c-3628fc3e09c0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:18.539465 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e45250f8-6999-4cd7-b18c-3628fc3e09c0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:18.584592 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1bb48d78-f0f0-4e68-9460-2d622d350699 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:18.585196 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1bb48d78-f0f0-4e68-9460-2d622d350699 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:18.591245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1bb48d78-f0f0-4e68-9460-2d622d350699 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:18.591689 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1bb48d78-f0f0-4e68-9460-2d622d350699 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:18.592445 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1bb48d78-f0f0-4e68-9460-2d622d350699 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:18.592877 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1bb48d78-f0f0-4e68-9460-2d622d350699 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:18.671567 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e45250f8-6999-4cd7-b18c-3628fc3e09c0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:18.680309 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e45250f8-6999-4cd7-b18c-3628fc3e09c0 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1553 microversion: 2.1 time: 0.154493 Jul 27 07:51:18.680934 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 150/294] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:18 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:18.708175 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-61c10967-79a8-4c54-af1b-70f2f5025da6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:18.708780 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-61c10967-79a8-4c54-af1b-70f2f5025da6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:18.714755 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-61c10967-79a8-4c54-af1b-70f2f5025da6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:18.715231 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-61c10967-79a8-4c54-af1b-70f2f5025da6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:18.715987 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-61c10967-79a8-4c54-af1b-70f2f5025da6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:18.716419 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-61c10967-79a8-4c54-af1b-70f2f5025da6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:18.724688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1bb48d78-f0f0-4e68-9460-2d622d350699 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:18.732069 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1bb48d78-f0f0-4e68-9460-2d622d350699 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1315 microversion: 2.1 time: 0.151191 Jul 27 07:51:18.732641 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 145/295] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:18 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:18.851278 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-61c10967-79a8-4c54-af1b-70f2f5025da6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:18.858697 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-61c10967-79a8-4c54-af1b-70f2f5025da6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.154856 Jul 27 07:51:18.859303 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 151/296] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:18 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:19.701287 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e39342d7-4ff7-480e-8264-283d90b8e6e4 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:19.701903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e39342d7-4ff7-480e-8264-283d90b8e6e4 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:19.708108 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e39342d7-4ff7-480e-8264-283d90b8e6e4 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:19.708559 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e39342d7-4ff7-480e-8264-283d90b8e6e4 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:19.709330 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e39342d7-4ff7-480e-8264-283d90b8e6e4 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:19.709762 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e39342d7-4ff7-480e-8264-283d90b8e6e4 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:19.752289 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5f1fdd86-670d-4ba1-9197-8411b3d1a237 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:19.753603 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5f1fdd86-670d-4ba1-9197-8411b3d1a237 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:19.760035 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5f1fdd86-670d-4ba1-9197-8411b3d1a237 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:19.760475 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5f1fdd86-670d-4ba1-9197-8411b3d1a237 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:19.761230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5f1fdd86-670d-4ba1-9197-8411b3d1a237 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:19.761655 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5f1fdd86-670d-4ba1-9197-8411b3d1a237 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:19.836823 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e39342d7-4ff7-480e-8264-283d90b8e6e4 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:19.845128 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e39342d7-4ff7-480e-8264-283d90b8e6e4 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1553 microversion: 2.1 time: 0.147612 Jul 27 07:51:19.845712 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 146/297] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:19 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:19.879990 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-8165dfca-ea69-42ec-a772-df55c4a4d0a1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:19.880513 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-8165dfca-ea69-42ec-a772-df55c4a4d0a1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:19.886856 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8165dfca-ea69-42ec-a772-df55c4a4d0a1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:19.887339 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8165dfca-ea69-42ec-a772-df55c4a4d0a1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:19.888122 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8165dfca-ea69-42ec-a772-df55c4a4d0a1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:19.888565 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8165dfca-ea69-42ec-a772-df55c4a4d0a1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:19.895855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5f1fdd86-670d-4ba1-9197-8411b3d1a237 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:19.903179 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5f1fdd86-670d-4ba1-9197-8411b3d1a237 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1315 microversion: 2.1 time: 0.154629 Jul 27 07:51:19.903744 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 152/298] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:19 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:20.037722 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8165dfca-ea69-42ec-a772-df55c4a4d0a1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:20.046115 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-8165dfca-ea69-42ec-a772-df55c4a4d0a1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.170055 Jul 27 07:51:20.046699 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 147/299] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:19 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:20.868462 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e53ed5c6-8986-44da-9bd6-d7fe0f25397a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:20.869066 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e53ed5c6-8986-44da-9bd6-d7fe0f25397a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:20.875596 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e53ed5c6-8986-44da-9bd6-d7fe0f25397a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:20.876044 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e53ed5c6-8986-44da-9bd6-d7fe0f25397a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:20.876803 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e53ed5c6-8986-44da-9bd6-d7fe0f25397a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:20.877239 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e53ed5c6-8986-44da-9bd6-d7fe0f25397a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:20.924083 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-634e5715-06e0-4231-9c43-367962a91123 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:20.924695 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-634e5715-06e0-4231-9c43-367962a91123 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:20.930727 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-634e5715-06e0-4231-9c43-367962a91123 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:20.931210 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-634e5715-06e0-4231-9c43-367962a91123 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:20.931973 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-634e5715-06e0-4231-9c43-367962a91123 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:20.932411 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-634e5715-06e0-4231-9c43-367962a91123 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:20.935108 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=100 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:21.013147 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e53ed5c6-8986-44da-9bd6-d7fe0f25397a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:21.021581 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e53ed5c6-8986-44da-9bd6-d7fe0f25397a tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1553 microversion: 2.1 time: 0.156951 Jul 27 07:51:21.022181 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 153/300] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:20 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:21.063077 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-634e5715-06e0-4231-9c43-367962a91123 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:21.068221 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7c8bb142-4ee4-4e2b-bc9f-52f9e31ec988 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:21.068915 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7c8bb142-4ee4-4e2b-bc9f-52f9e31ec988 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:21.071087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-634e5715-06e0-4231-9c43-367962a91123 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1315 microversion: 2.1 time: 0.150738 Jul 27 07:51:21.072651 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 148/301] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:20 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:21.075245 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7c8bb142-4ee4-4e2b-bc9f-52f9e31ec988 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:21.075757 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7c8bb142-4ee4-4e2b-bc9f-52f9e31ec988 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:21.076624 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7c8bb142-4ee4-4e2b-bc9f-52f9e31ec988 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:21.077141 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7c8bb142-4ee4-4e2b-bc9f-52f9e31ec988 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:21.205657 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7c8bb142-4ee4-4e2b-bc9f-52f9e31ec988 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:21.213957 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7c8bb142-4ee4-4e2b-bc9f-52f9e31ec988 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.149958 Jul 27 07:51:21.214531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 154/302] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:21 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:22.043261 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2c549207-1a81-4a6d-b994-8081f6a2fd0f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:22.043797 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2c549207-1a81-4a6d-b994-8081f6a2fd0f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:22.045632 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=77 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:22.051217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2c549207-1a81-4a6d-b994-8081f6a2fd0f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:22.051670 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2c549207-1a81-4a6d-b994-8081f6a2fd0f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:22.052440 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2c549207-1a81-4a6d-b994-8081f6a2fd0f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:22.052872 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2c549207-1a81-4a6d-b994-8081f6a2fd0f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:22.090939 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c740093a-c1fd-4a32-9691-d9f60518e3b0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:22.091555 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c740093a-c1fd-4a32-9691-d9f60518e3b0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:22.098028 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c740093a-c1fd-4a32-9691-d9f60518e3b0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:22.098474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c740093a-c1fd-4a32-9691-d9f60518e3b0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:22.099527 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c740093a-c1fd-4a32-9691-d9f60518e3b0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:22.099966 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c740093a-c1fd-4a32-9691-d9f60518e3b0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:22.186434 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2c549207-1a81-4a6d-b994-8081f6a2fd0f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:22.196643 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2c549207-1a81-4a6d-b994-8081f6a2fd0f tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1553 microversion: 2.1 time: 0.157280 Jul 27 07:51:22.197230 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 149/303] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:22 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:22.235881 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2952fd5d-04d0-431d-9140-dc82007ff1ad tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:22.236105 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c740093a-c1fd-4a32-9691-d9f60518e3b0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:22.236493 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2952fd5d-04d0-431d-9140-dc82007ff1ad tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:22.243052 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2952fd5d-04d0-431d-9140-dc82007ff1ad tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:22.243500 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2952fd5d-04d0-431d-9140-dc82007ff1ad tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:22.244277 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2952fd5d-04d0-431d-9140-dc82007ff1ad tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:22.244945 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2952fd5d-04d0-431d-9140-dc82007ff1ad tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:22.253971 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c740093a-c1fd-4a32-9691-d9f60518e3b0 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1465 microversion: 2.1 time: 0.166763 Jul 27 07:51:22.254596 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 155/304] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:22 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1465 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:22.384760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2952fd5d-04d0-431d-9140-dc82007ff1ad tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:22.392749 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2952fd5d-04d0-431d-9140-dc82007ff1ad tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.160545 Jul 27 07:51:22.393338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 150/305] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:22 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:22.426022 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a199a7c1-26cb-4937-8fe6-ce17019eff16 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:22.426695 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a199a7c1-26cb-4937-8fe6-ce17019eff16 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:22.432728 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a199a7c1-26cb-4937-8fe6-ce17019eff16 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:22.433175 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a199a7c1-26cb-4937-8fe6-ce17019eff16 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:22.433945 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a199a7c1-26cb-4937-8fe6-ce17019eff16 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:22.434380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a199a7c1-26cb-4937-8fe6-ce17019eff16 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:22.459525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a199a7c1-26cb-4937-8fe6-ce17019eff16 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 07:51:22.537679 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a199a7c1-26cb-4937-8fe6-ce17019eff16 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "DELETE /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 204 len: 0 microversion: 2.1 time: 0.114912 Jul 27 07:51:22.538642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 156/306] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 07:51:22 2022] DELETE /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 07:51:22.547057 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-849ad223-32dc-431e-ad77-bdeb14ed4a81 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:22.547698 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-849ad223-32dc-431e-ad77-bdeb14ed4a81 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:22.554153 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-849ad223-32dc-431e-ad77-bdeb14ed4a81 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:22.554598 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-849ad223-32dc-431e-ad77-bdeb14ed4a81 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:22.555408 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-849ad223-32dc-431e-ad77-bdeb14ed4a81 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:22.555834 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-849ad223-32dc-431e-ad77-bdeb14ed4a81 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:22.684794 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-849ad223-32dc-431e-ad77-bdeb14ed4a81 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:22.692824 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-849ad223-32dc-431e-ad77-bdeb14ed4a81 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1471 microversion: 2.1 time: 0.149677 Jul 27 07:51:22.693379 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 151/307] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:22 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:23.219308 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d32e0d64-6e95-4a97-a6c8-719df714a24d tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:23.220009 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d32e0d64-6e95-4a97-a6c8-719df714a24d tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:23.227471 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d32e0d64-6e95-4a97-a6c8-719df714a24d tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:23.227921 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d32e0d64-6e95-4a97-a6c8-719df714a24d tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:23.228684 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d32e0d64-6e95-4a97-a6c8-719df714a24d tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:23.229126 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d32e0d64-6e95-4a97-a6c8-719df714a24d tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:23.359271 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d32e0d64-6e95-4a97-a6c8-719df714a24d tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:23.367346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d32e0d64-6e95-4a97-a6c8-719df714a24d tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1553 microversion: 2.1 time: 0.153472 Jul 27 07:51:23.367897 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 157/308] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:23 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:23.414750 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-3f649ac7-80f4-4698-9c31-d320b1567207 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:23.415392 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-3f649ac7-80f4-4698-9c31-d320b1567207 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:23.421425 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3f649ac7-80f4-4698-9c31-d320b1567207 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:23.421873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3f649ac7-80f4-4698-9c31-d320b1567207 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:23.422664 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3f649ac7-80f4-4698-9c31-d320b1567207 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:23.423119 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3f649ac7-80f4-4698-9c31-d320b1567207 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:23.551072 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3f649ac7-80f4-4698-9c31-d320b1567207 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:23.558516 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-3f649ac7-80f4-4698-9c31-d320b1567207 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.147744 Jul 27 07:51:23.559110 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 152/309] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:23 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:23.713639 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c9111f5e-1eb2-4962-b1ac-e0cf0b8ae22f tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:23.714251 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c9111f5e-1eb2-4962-b1ac-e0cf0b8ae22f tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:23.721581 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9111f5e-1eb2-4962-b1ac-e0cf0b8ae22f tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:23.722047 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9111f5e-1eb2-4962-b1ac-e0cf0b8ae22f tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:23.722821 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9111f5e-1eb2-4962-b1ac-e0cf0b8ae22f tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:23.723276 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9111f5e-1eb2-4962-b1ac-e0cf0b8ae22f tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:23.849158 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c9111f5e-1eb2-4962-b1ac-e0cf0b8ae22f tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:23.856561 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c9111f5e-1eb2-4962-b1ac-e0cf0b8ae22f tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1471 microversion: 2.1 time: 0.146835 Jul 27 07:51:23.857130 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 158/310] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:23 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1471 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:24.387497 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b2b4dac4-1d0e-436e-8c5b-206f1a3600a9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:24.388204 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b2b4dac4-1d0e-436e-8c5b-206f1a3600a9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:24.395183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b2b4dac4-1d0e-436e-8c5b-206f1a3600a9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:24.395634 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b2b4dac4-1d0e-436e-8c5b-206f1a3600a9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:24.396405 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b2b4dac4-1d0e-436e-8c5b-206f1a3600a9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:24.396867 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b2b4dac4-1d0e-436e-8c5b-206f1a3600a9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:24.526862 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b2b4dac4-1d0e-436e-8c5b-206f1a3600a9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:24.534910 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b2b4dac4-1d0e-436e-8c5b-206f1a3600a9 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1553 microversion: 2.1 time: 0.151136 Jul 27 07:51:24.535418 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 153/311] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:24 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:24.580117 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-baa72da6-d5e5-4417-a1f9-284d375ca2da tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:24.580725 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-baa72da6-d5e5-4417-a1f9-284d375ca2da tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:24.588068 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-baa72da6-d5e5-4417-a1f9-284d375ca2da tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:24.588514 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-baa72da6-d5e5-4417-a1f9-284d375ca2da tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:24.589287 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-baa72da6-d5e5-4417-a1f9-284d375ca2da tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:24.589724 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-baa72da6-d5e5-4417-a1f9-284d375ca2da tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:24.718530 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-baa72da6-d5e5-4417-a1f9-284d375ca2da tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:24.726357 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-baa72da6-d5e5-4417-a1f9-284d375ca2da tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.150150 Jul 27 07:51:24.726961 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 159/312] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:24 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:24.877172 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-74c5b7f6-f424-43f2-8a49-47ff88b00b2b tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:24.878389 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-74c5b7f6-f424-43f2-8a49-47ff88b00b2b tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:24.885250 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-74c5b7f6-f424-43f2-8a49-47ff88b00b2b tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:24.886174 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-74c5b7f6-f424-43f2-8a49-47ff88b00b2b tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:24.886465 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-74c5b7f6-f424-43f2-8a49-47ff88b00b2b tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:24.886932 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-74c5b7f6-f424-43f2-8a49-47ff88b00b2b tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:25.019158 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-74c5b7f6-f424-43f2-8a49-47ff88b00b2b tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:25.026668 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-74c5b7f6-f424-43f2-8a49-47ff88b00b2b tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1471 microversion: 2.1 time: 0.153609 Jul 27 07:51:25.027269 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 154/313] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:24 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:25.555978 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1b2173c9-a3c8-45b8-b8a0-9102ca23116e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:25.556584 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1b2173c9-a3c8-45b8-b8a0-9102ca23116e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:25.562606 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1b2173c9-a3c8-45b8-b8a0-9102ca23116e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:25.563093 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1b2173c9-a3c8-45b8-b8a0-9102ca23116e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:25.563857 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1b2173c9-a3c8-45b8-b8a0-9102ca23116e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:25.564294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1b2173c9-a3c8-45b8-b8a0-9102ca23116e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:25.696210 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1b2173c9-a3c8-45b8-b8a0-9102ca23116e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:25.704010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1b2173c9-a3c8-45b8-b8a0-9102ca23116e tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1553 microversion: 2.1 time: 0.151889 Jul 27 07:51:25.704562 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 160/314] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:25 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:25.747371 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-29b7839c-da9e-4ae9-a5ef-aed3468fed46 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:25.747983 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-29b7839c-da9e-4ae9-a5ef-aed3468fed46 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:25.753935 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-29b7839c-da9e-4ae9-a5ef-aed3468fed46 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:25.754382 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-29b7839c-da9e-4ae9-a5ef-aed3468fed46 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:25.755181 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-29b7839c-da9e-4ae9-a5ef-aed3468fed46 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:25.755618 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-29b7839c-da9e-4ae9-a5ef-aed3468fed46 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:25.884732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-29b7839c-da9e-4ae9-a5ef-aed3468fed46 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:25.892274 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-29b7839c-da9e-4ae9-a5ef-aed3468fed46 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.148727 Jul 27 07:51:25.892843 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 155/315] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:25 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:26.048036 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b7417cd7-aaa7-4c4e-954e-23f9eddec3ee tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:26.048644 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b7417cd7-aaa7-4c4e-954e-23f9eddec3ee tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:26.054626 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b7417cd7-aaa7-4c4e-954e-23f9eddec3ee tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:26.055112 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b7417cd7-aaa7-4c4e-954e-23f9eddec3ee tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:26.055879 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b7417cd7-aaa7-4c4e-954e-23f9eddec3ee tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:26.056317 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b7417cd7-aaa7-4c4e-954e-23f9eddec3ee tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:26.186082 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b7417cd7-aaa7-4c4e-954e-23f9eddec3ee tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:26.194717 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b7417cd7-aaa7-4c4e-954e-23f9eddec3ee tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1471 microversion: 2.1 time: 0.150578 Jul 27 07:51:26.195518 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 161/316] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:26 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:26.726640 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b43186e0-cc64-4c36-bfc1-3b497416ca13 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:26.727192 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b43186e0-cc64-4c36-bfc1-3b497416ca13 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:26.733224 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b43186e0-cc64-4c36-bfc1-3b497416ca13 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:26.733666 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b43186e0-cc64-4c36-bfc1-3b497416ca13 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:26.734416 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b43186e0-cc64-4c36-bfc1-3b497416ca13 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:26.734848 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b43186e0-cc64-4c36-bfc1-3b497416ca13 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:26.862072 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b43186e0-cc64-4c36-bfc1-3b497416ca13 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:26.870669 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b43186e0-cc64-4c36-bfc1-3b497416ca13 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1553 microversion: 2.1 time: 0.149053 Jul 27 07:51:26.871361 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 156/317] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:26 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:26.913975 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a63a1a87-2151-494f-b11f-ad74c7cff0c2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:26.914587 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a63a1a87-2151-494f-b11f-ad74c7cff0c2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:26.921069 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a63a1a87-2151-494f-b11f-ad74c7cff0c2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:26.921515 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a63a1a87-2151-494f-b11f-ad74c7cff0c2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:26.922277 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a63a1a87-2151-494f-b11f-ad74c7cff0c2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:26.922712 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a63a1a87-2151-494f-b11f-ad74c7cff0c2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:27.056368 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a63a1a87-2151-494f-b11f-ad74c7cff0c2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:27.064132 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a63a1a87-2151-494f-b11f-ad74c7cff0c2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.154472 Jul 27 07:51:27.064714 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 162/318] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:26 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:27.216806 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-37d714b6-d0a5-4e04-acb4-dd65e86688cc tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:27.217408 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-37d714b6-d0a5-4e04-acb4-dd65e86688cc tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:27.224411 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-37d714b6-d0a5-4e04-acb4-dd65e86688cc tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:27.224866 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-37d714b6-d0a5-4e04-acb4-dd65e86688cc tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:27.225609 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-37d714b6-d0a5-4e04-acb4-dd65e86688cc tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:27.226036 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-37d714b6-d0a5-4e04-acb4-dd65e86688cc tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:27.355275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-37d714b6-d0a5-4e04-acb4-dd65e86688cc tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:27.362864 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-37d714b6-d0a5-4e04-acb4-dd65e86688cc tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1471 microversion: 2.1 time: 0.149888 Jul 27 07:51:27.363459 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 157/319] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:27 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:27.891674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f40b3b82-703e-433f-aba6-16bba0e5e71b tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:27.892283 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f40b3b82-703e-433f-aba6-16bba0e5e71b tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:27.894467 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:27.900164 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f40b3b82-703e-433f-aba6-16bba0e5e71b tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:27.900613 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f40b3b82-703e-433f-aba6-16bba0e5e71b tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:27.901467 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f40b3b82-703e-433f-aba6-16bba0e5e71b tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:27.901927 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f40b3b82-703e-433f-aba6-16bba0e5e71b tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:28.041998 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f40b3b82-703e-433f-aba6-16bba0e5e71b tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:28.045453 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:28.050763 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f40b3b82-703e-433f-aba6-16bba0e5e71b tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1553 microversion: 2.1 time: 0.162975 Jul 27 07:51:28.056313 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-efc63de5-8bcb-43a8-befe-dd1c99a70eeb req-462c544f-cf4d-4349-ae17-5d2ce9f917ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f7e2e6-f10c-45e8-aacb-67a155d5da44", "name": "network-vif-unplugged", "status": "completed", "tag": "37d19150-619f-49f8-903f-5e239b14816f"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:51:28.061516 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 163/320] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:27 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:28.066743 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-efc63de5-8bcb-43a8-befe-dd1c99a70eeb req-462c544f-cf4d-4349-ae17-5d2ce9f917ec service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:28.067201 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-efc63de5-8bcb-43a8-befe-dd1c99a70eeb req-462c544f-cf4d-4349-ae17-5d2ce9f917ec service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:28.079203 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-efc63de5-8bcb-43a8-befe-dd1c99a70eeb req-462c544f-cf4d-4349-ae17-5d2ce9f917ec service nova] Creating event network-vif-unplugged:37d19150-619f-49f8-903f-5e239b14816f for instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 on hv-cinder-82549 Jul 27 07:51:28.085441 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-efc63de5-8bcb-43a8-befe-dd1c99a70eeb req-462c544f-cf4d-4349-ae17-5d2ce9f917ec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032461 Jul 27 07:51:28.086104 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 158/321] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:51:28.089301 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b40516d6-32f4-45c0-a5bd-d27daa5fd335 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:28.090136 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b40516d6-32f4-45c0-a5bd-d27daa5fd335 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:28.098470 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b40516d6-32f4-45c0-a5bd-d27daa5fd335 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:28.099328 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b40516d6-32f4-45c0-a5bd-d27daa5fd335 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:28.100356 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b40516d6-32f4-45c0-a5bd-d27daa5fd335 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:28.100872 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b40516d6-32f4-45c0-a5bd-d27daa5fd335 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:28.265639 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b40516d6-32f4-45c0-a5bd-d27daa5fd335 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:28.273433 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b40516d6-32f4-45c0-a5bd-d27daa5fd335 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.191628 Jul 27 07:51:28.274009 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 164/322] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:28 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:28.384536 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-15c08721-cc5e-4057-8925-fe8d7d93b2c8 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:28.385256 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-15c08721-cc5e-4057-8925-fe8d7d93b2c8 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:28.391761 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-15c08721-cc5e-4057-8925-fe8d7d93b2c8 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:28.392213 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-15c08721-cc5e-4057-8925-fe8d7d93b2c8 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:28.393036 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-15c08721-cc5e-4057-8925-fe8d7d93b2c8 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:28.393468 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-15c08721-cc5e-4057-8925-fe8d7d93b2c8 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:28.880208 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-15c08721-cc5e-4057-8925-fe8d7d93b2c8 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:28.891955 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-15c08721-cc5e-4057-8925-fe8d7d93b2c8 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1471 microversion: 2.1 time: 0.511801 Jul 27 07:51:28.892925 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 159/323] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:28 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1471 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:29.071138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-92538755-3f8d-4e05-8e98-6256532301ba req-b2276f3f-ac30-444b-b8f6-d41151219824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f7e2e6-f10c-45e8-aacb-67a155d5da44", "name": "network-vif-deleted", "tag": "37d19150-619f-49f8-903f-5e239b14816f"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:51:29.081531 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-bb6b607a-9d02-4847-a1b7-48bbe6770667 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:29.082503 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-92538755-3f8d-4e05-8e98-6256532301ba req-b2276f3f-ac30-444b-b8f6-d41151219824 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:29.082626 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-bb6b607a-9d02-4847-a1b7-48bbe6770667 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:29.082733 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-92538755-3f8d-4e05-8e98-6256532301ba req-b2276f3f-ac30-444b-b8f6-d41151219824 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:29.088765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bb6b607a-9d02-4847-a1b7-48bbe6770667 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:29.089302 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bb6b607a-9d02-4847-a1b7-48bbe6770667 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:29.090161 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bb6b607a-9d02-4847-a1b7-48bbe6770667 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:29.090723 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bb6b607a-9d02-4847-a1b7-48bbe6770667 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:29.094673 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-92538755-3f8d-4e05-8e98-6256532301ba req-b2276f3f-ac30-444b-b8f6-d41151219824 service nova] Creating event network-vif-deleted:37d19150-619f-49f8-903f-5e239b14816f for instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 on hv-cinder-82549 Jul 27 07:51:29.100741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-92538755-3f8d-4e05-8e98-6256532301ba req-b2276f3f-ac30-444b-b8f6-d41151219824 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033857 Jul 27 07:51:29.101333 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 165/324] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:51:29.162619 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-bb6b607a-9d02-4847-a1b7-48bbe6770667 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:29.171460 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-bb6b607a-9d02-4847-a1b7-48bbe6770667 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1511 microversion: 2.1 time: 0.093322 Jul 27 07:51:29.172086 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 160/325] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:29 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1511 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:29.296110 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-bdbbebd8-b5e4-48a9-92b6-715a5fc84730 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:29.296850 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-bdbbebd8-b5e4-48a9-92b6-715a5fc84730 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:29.303223 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bdbbebd8-b5e4-48a9-92b6-715a5fc84730 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:29.303667 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bdbbebd8-b5e4-48a9-92b6-715a5fc84730 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:29.304523 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bdbbebd8-b5e4-48a9-92b6-715a5fc84730 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:29.304960 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bdbbebd8-b5e4-48a9-92b6-715a5fc84730 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:29.434569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bdbbebd8-b5e4-48a9-92b6-715a5fc84730 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:29.442520 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-bdbbebd8-b5e4-48a9-92b6-715a5fc84730 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.150891 Jul 27 07:51:29.443119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 166/326] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:29 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:29.919799 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b472b5ef-bd91-47fe-a3dd-ac9c02a67fbd tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:29.920541 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b472b5ef-bd91-47fe-a3dd-ac9c02a67fbd tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:29.928641 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b472b5ef-bd91-47fe-a3dd-ac9c02a67fbd tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:29.928975 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b472b5ef-bd91-47fe-a3dd-ac9c02a67fbd tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:29.929985 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b472b5ef-bd91-47fe-a3dd-ac9c02a67fbd tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:29.930619 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b472b5ef-bd91-47fe-a3dd-ac9c02a67fbd tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:30.059269 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b472b5ef-bd91-47fe-a3dd-ac9c02a67fbd tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15dd07d86ec45f8ab90abedf599201c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885070b1ca554f888588bc0661b6e60e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:30.075233 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b472b5ef-bd91-47fe-a3dd-ac9c02a67fbd tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 200 len: 1429 microversion: 2.1 time: 0.161523 Jul 27 07:51:30.076326 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 161/327] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:29 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 1429 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:30.195332 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3ae04db2-7665-4675-9dfe-b965468ef5d4 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:30.196039 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3ae04db2-7665-4675-9dfe-b965468ef5d4 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:30.203517 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3ae04db2-7665-4675-9dfe-b965468ef5d4 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:30.204158 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3ae04db2-7665-4675-9dfe-b965468ef5d4 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:30.205289 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3ae04db2-7665-4675-9dfe-b965468ef5d4 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:30.205856 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3ae04db2-7665-4675-9dfe-b965468ef5d4 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:30.242094 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3ae04db2-7665-4675-9dfe-b965468ef5d4 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:30.242719 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3ae04db2-7665-4675-9dfe-b965468ef5d4 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:30.243262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-3ae04db2-7665-4675-9dfe-b965468ef5d4 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lazy-loading 'fault' on Instance uuid 41f7e2e6-f10c-45e8-aacb-67a155d5da44 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:51:30.309175 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3ae04db2-7665-4675-9dfe-b965468ef5d4 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2d0a6b52c8465a8ae2f46d1270ae38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e9270b6ae24d75b778de7e0ade50fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:30.317444 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3ae04db2-7665-4675-9dfe-b965468ef5d4 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 200 len: 1350 microversion: 2.1 time: 0.127090 Jul 27 07:51:30.318126 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 167/328] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:30 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 1350 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:30.466852 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9884f4d3-73ec-4256-8031-a770c81b6e4b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:30.467421 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-9884f4d3-73ec-4256-8031-a770c81b6e4b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:30.476648 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9884f4d3-73ec-4256-8031-a770c81b6e4b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:30.477095 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9884f4d3-73ec-4256-8031-a770c81b6e4b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:30.477868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9884f4d3-73ec-4256-8031-a770c81b6e4b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:30.478303 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9884f4d3-73ec-4256-8031-a770c81b6e4b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:30.629694 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9884f4d3-73ec-4256-8031-a770c81b6e4b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:30.637131 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9884f4d3-73ec-4256-8031-a770c81b6e4b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.174324 Jul 27 07:51:30.637682 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 162/329] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:30 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:31.097658 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d419d4bb-2a60-4a0b-91e4-27c3c30238f2 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:31.098275 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d419d4bb-2a60-4a0b-91e4-27c3c30238f2 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] [instance: 98cc3d7e-e045-4893-a68c-20e44dd64485] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:31.104776 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d419d4bb-2a60-4a0b-91e4-27c3c30238f2 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:31.105264 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d419d4bb-2a60-4a0b-91e4-27c3c30238f2 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:31.106051 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d419d4bb-2a60-4a0b-91e4-27c3c30238f2 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:31.106467 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d419d4bb-2a60-4a0b-91e4-27c3c30238f2 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:31.117396 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-f0649212-542e-4594-adbc-6f9968ffa4e6 req-1a475ec2-51f3-4f65-a6ed-d1ff527c6209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98cc3d7e-e045-4893-a68c-20e44dd64485", "name": "network-vif-deleted", "tag": "841cfe6a-3a35-4865-a8d2-462af786e66d"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:51:31.122129 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-d419d4bb-2a60-4a0b-91e4-27c3c30238f2 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] HTTP exception thrown: Instance 98cc3d7e-e045-4893-a68c-20e44dd64485 could not be found. Jul 27 07:51:31.126845 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-f0649212-542e-4594-adbc-6f9968ffa4e6 req-1a475ec2-51f3-4f65-a6ed-d1ff527c6209 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:31.127356 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-f0649212-542e-4594-adbc-6f9968ffa4e6 req-1a475ec2-51f3-4f65-a6ed-d1ff527c6209 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d419d4bb-2a60-4a0b-91e4-27c3c30238f2 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Request method failure captured: Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 HTTP/1.1 Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O5ZnzRFXmvWA22p3NZ6Mv2YQirB6onvEb9qk3m583AeRqUcOu4FY7bHdXbt3YeEiklEd-mT3S4vgeu_TrfaRqSMh34g2OthrhEMxpoPoMxGnZztI3LBki5QR5cL_wxGQDlrMWiVWM_46fjkkvUHg2FCVJbjOSGvumTkSnXqaDgfrUI Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 885070b1ca554f888588bc0661b6e60e Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesNegativeTest-1377388080 Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 07:51:31.131291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 07:51:31.133740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/885070b1ca554f888588bc0661b6e60e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_885070b1ca554f888588bc0661b6e60e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/885070b1ca554f888588bc0661b6e60e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/885070b1ca554f888588bc0661b6e60e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:51:31.133740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesNegativeTest-1377388080 Jul 27 07:51:31.133740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 885070b1ca554f888588bc0661b6e60e Jul 27 07:51:31.133740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesNegativeTest-1377388080 Jul 27 07:51:31.133740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesNegativeTest-1377388080-project Jul 27 07:51:31.133740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 07:51:31.133740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 07:51:31.133740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: c15dd07d86ec45f8ab90abedf599201c Jul 27 07:51:31.133740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesNegativeTest-1377388080-project Jul 27 07:51:31.133740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 07:51:31.133740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance 98cc3d7e-e045-4893-a68c-20e44dd64485 could not be found. Jul 27 07:51:31.133740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': '98cc3d7e-e045-4893-a68c-20e44dd64485'} Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98cc3d7e-e045-4893-a68c-20e44dd64485 could not be found. Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:51:31.134797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:51:31.136145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:51:31.136145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 07:51:31.136145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 07:51:31.136145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 07:51:31.136145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 07:51:31.136145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 07:51:31.136145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:51:31.136145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98cc3d7e-e045-4893-a68c-20e44dd64485 could not be found. Jul 27 07:51:31.136145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:31.136145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:51:31.136145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:31.136145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:51:31.136145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:51:31.136145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:51:31.136145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:51:31.136145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:51:31.136145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98cc3d7e-e045-4893-a68c-20e44dd64485 could not be found. Jul 27 07:51:31.136145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:31.139122 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d419d4bb-2a60-4a0b-91e4-27c3c30238f2 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] Returning 404 to user: Instance 98cc3d7e-e045-4893-a68c-20e44dd64485 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:51:31.139122 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d419d4bb-2a60-4a0b-91e4-27c3c30238f2 tempest-VolumesNegativeTest-1377388080 tempest-VolumesNegativeTest-1377388080-project] 10.222.0.18 "GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485" status: 404 len: 111 microversion: 2.1 time: 0.039120 Jul 27 07:51:31.139122 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 168/330] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:31 2022] GET /compute/v2.1/servers/98cc3d7e-e045-4893-a68c-20e44dd64485 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 07:51:31.146543 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-f0649212-542e-4594-adbc-6f9968ffa4e6 req-1a475ec2-51f3-4f65-a6ed-d1ff527c6209 service nova] Creating event network-vif-deleted:841cfe6a-3a35-4865-a8d2-462af786e66d for instance 98cc3d7e-e045-4893-a68c-20e44dd64485 on hv-cinder-82549 Jul 27 07:51:31.151844 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-f0649212-542e-4594-adbc-6f9968ffa4e6 req-1a475ec2-51f3-4f65-a6ed-d1ff527c6209 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038359 Jul 27 07:51:31.152436 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 163/331] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:51:31.349309 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2dbfb09f-1d3e-4c7a-8e81-b86f2c6621ba tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:31.350470 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2dbfb09f-1d3e-4c7a-8e81-b86f2c6621ba tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:31.358194 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2dbfb09f-1d3e-4c7a-8e81-b86f2c6621ba tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:31.358655 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2dbfb09f-1d3e-4c7a-8e81-b86f2c6621ba tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:31.359468 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2dbfb09f-1d3e-4c7a-8e81-b86f2c6621ba tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:31.359908 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2dbfb09f-1d3e-4c7a-8e81-b86f2c6621ba tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:31.375428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-2dbfb09f-1d3e-4c7a-8e81-b86f2c6621ba tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] HTTP exception thrown: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2dbfb09f-1d3e-4c7a-8e81-b86f2c6621ba tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Request method failure captured: Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 HTTP/1.1 Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O4XZJJTyy9FugIQZaeFOpo4WiUaWeMSzStVoRJciUKvQ8tzQTz-UwzmSlNNdkvvH688js-jaP0q5oQSeuHGp3QGnbYIeZZ7mvVAksJ7zh2xsn3d9iH6TSe7vpWAnsd-uwG4gEYaFwegrzhCK6ouSCqdI58HZHo-c8kFQ4uRHP_UJ48 Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 81e9270b6ae24d75b778de7e0ade50fc Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-DeleteServersTestJSON-1889476351 Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 07:51:31.377538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 07:51:31.379773 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81e9270b6ae24d75b778de7e0ade50fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_81e9270b6ae24d75b778de7e0ade50fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81e9270b6ae24d75b778de7e0ade50fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/81e9270b6ae24d75b778de7e0ade50fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:51:31.379773 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-DeleteServersTestJSON-1889476351 Jul 27 07:51:31.379773 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 81e9270b6ae24d75b778de7e0ade50fc Jul 27 07:51:31.379773 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-DeleteServersTestJSON-1889476351 Jul 27 07:51:31.379773 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-DeleteServersTestJSON-1889476351-project Jul 27 07:51:31.379773 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 07:51:31.379773 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 07:51:31.379773 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: be2d0a6b52c8465a8ae2f46d1270ae38 Jul 27 07:51:31.379773 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-DeleteServersTestJSON-1889476351-project Jul 27 07:51:31.379773 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 07:51:31.379773 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:31.379773 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': '41f7e2e6-f10c-45e8-aacb-67a155d5da44'} Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:51:31.380628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:51:31.381905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:51:31.381905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 07:51:31.381905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 07:51:31.381905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 07:51:31.381905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 07:51:31.381905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 07:51:31.381905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:51:31.381905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:31.381905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:31.381905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:51:31.381905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:31.381905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:51:31.381905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:51:31.381905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:51:31.381905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:51:31.381905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:51:31.381905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:31.381905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:31.383273 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2dbfb09f-1d3e-4c7a-8e81-b86f2c6621ba tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Returning 404 to user: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:51:31.383273 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2dbfb09f-1d3e-4c7a-8e81-b86f2c6621ba tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 404 len: 111 microversion: 2.1 time: 0.034714 Jul 27 07:51:31.384169 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 169/332] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:31 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 07:51:31.507271 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d3fb41b7-f6d4-47c5-befb-d989f2482964 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:31.510179 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d3fb41b7-f6d4-47c5-befb-d989f2482964 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:31.517614 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d3fb41b7-f6d4-47c5-befb-d989f2482964 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:31.518069 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d3fb41b7-f6d4-47c5-befb-d989f2482964 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:31.518836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d3fb41b7-f6d4-47c5-befb-d989f2482964 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:31.519605 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d3fb41b7-f6d4-47c5-befb-d989f2482964 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:31.657902 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d5cd3ec8-ef4a-4231-ae5a-21338a031b70 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:31.658524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d5cd3ec8-ef4a-4231-ae5a-21338a031b70 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:31.670979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d5cd3ec8-ef4a-4231-ae5a-21338a031b70 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:31.671691 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d5cd3ec8-ef4a-4231-ae5a-21338a031b70 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:31.673082 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d5cd3ec8-ef4a-4231-ae5a-21338a031b70 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:31.673774 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d5cd3ec8-ef4a-4231-ae5a-21338a031b70 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:31.691084 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-d3fb41b7-f6d4-47c5-befb-d989f2482964 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] HTTP exception thrown: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d3fb41b7-f6d4-47c5-befb-d989f2482964 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Request method failure captured: Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44/os-volume_attachments HTTP/1.1 Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O4XZJJTyy9FugIQZaeFOpo4WiUaWeMSzStVoRJciUKvQ8tzQTz-UwzmSlNNdkvvH688js-jaP0q5oQSeuHGp3QGnbYIeZZ7mvVAksJ7zh2xsn3d9iH6TSe7vpWAnsd-uwG4gEYaFwegrzhCK6ouSCqdI58HZHo-c8kFQ4uRHP_UJ48 Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 81e9270b6ae24d75b778de7e0ade50fc Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-DeleteServersTestJSON-1889476351 Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 07:51:31.701900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 07:51:31.703459 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81e9270b6ae24d75b778de7e0ade50fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_81e9270b6ae24d75b778de7e0ade50fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81e9270b6ae24d75b778de7e0ade50fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/81e9270b6ae24d75b778de7e0ade50fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:51:31.703459 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-DeleteServersTestJSON-1889476351 Jul 27 07:51:31.703459 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 81e9270b6ae24d75b778de7e0ade50fc Jul 27 07:51:31.703459 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-DeleteServersTestJSON-1889476351 Jul 27 07:51:31.703459 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-DeleteServersTestJSON-1889476351-project Jul 27 07:51:31.703459 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 07:51:31.703459 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 07:51:31.703459 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: be2d0a6b52c8465a8ae2f46d1270ae38 Jul 27 07:51:31.703459 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-DeleteServersTestJSON-1889476351-project Jul 27 07:51:31.703459 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 07:51:31.703459 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:31.703459 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'server_id': '41f7e2e6-f10c-45e8-aacb-67a155d5da44'} Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:51:31.704276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:31.705555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:51:31.707014 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d3fb41b7-f6d4-47c5-befb-d989f2482964 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Returning 404 to user: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:51:31.708814 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d3fb41b7-f6d4-47c5-befb-d989f2482964 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.207505 Jul 27 07:51:31.709500 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 164/333] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:51:31 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44/os-volume_attachments => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 07:51:31.946233 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d5cd3ec8-ef4a-4231-ae5a-21338a031b70 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:31.969908 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d5cd3ec8-ef4a-4231-ae5a-21338a031b70 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.315922 Jul 27 07:51:31.971360 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 170/334] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:31 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:33.003375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-64ca376a-3c1b-4087-a180-d9bfa68d39a7 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:33.004785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-64ca376a-3c1b-4087-a180-d9bfa68d39a7 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:33.017817 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-64ca376a-3c1b-4087-a180-d9bfa68d39a7 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:33.019773 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-64ca376a-3c1b-4087-a180-d9bfa68d39a7 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:33.020802 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-64ca376a-3c1b-4087-a180-d9bfa68d39a7 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:33.022509 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-64ca376a-3c1b-4087-a180-d9bfa68d39a7 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:33.041594 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0e446ebd-c7e9-49a0-a657-146c5084524c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:33.042808 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0e446ebd-c7e9-49a0-a657-146c5084524c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:33.051426 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0e446ebd-c7e9-49a0-a657-146c5084524c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:33.057610 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0e446ebd-c7e9-49a0-a657-146c5084524c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:33.059974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0e446ebd-c7e9-49a0-a657-146c5084524c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:33.060931 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0e446ebd-c7e9-49a0-a657-146c5084524c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:33.085451 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-0e446ebd-c7e9-49a0-a657-146c5084524c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] HTTP exception thrown: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0e446ebd-c7e9-49a0-a657-146c5084524c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Request method failure captured: Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: DELETE /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 HTTP/1.1 Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O4XZJJTyy9FugIQZaeFOpo4WiUaWeMSzStVoRJciUKvQ8tzQTz-UwzmSlNNdkvvH688js-jaP0q5oQSeuHGp3QGnbYIeZZ7mvVAksJ7zh2xsn3d9iH6TSe7vpWAnsd-uwG4gEYaFwegrzhCK6ouSCqdI58HZHo-c8kFQ4uRHP_UJ48 Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 81e9270b6ae24d75b778de7e0ade50fc Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-DeleteServersTestJSON-1889476351 Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 07:51:33.087881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 07:51:33.089133 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81e9270b6ae24d75b778de7e0ade50fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_81e9270b6ae24d75b778de7e0ade50fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81e9270b6ae24d75b778de7e0ade50fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/81e9270b6ae24d75b778de7e0ade50fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:51:33.089133 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-DeleteServersTestJSON-1889476351 Jul 27 07:51:33.089133 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 81e9270b6ae24d75b778de7e0ade50fc Jul 27 07:51:33.089133 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-DeleteServersTestJSON-1889476351 Jul 27 07:51:33.089133 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-DeleteServersTestJSON-1889476351-project Jul 27 07:51:33.089133 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 07:51:33.089133 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 07:51:33.089133 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: be2d0a6b52c8465a8ae2f46d1270ae38 Jul 27 07:51:33.089133 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-DeleteServersTestJSON-1889476351-project Jul 27 07:51:33.089133 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 07:51:33.089133 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:33.089133 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': '41f7e2e6-f10c-45e8-aacb-67a155d5da44'} Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:51:33.089875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:33.091409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:33.094317 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0e446ebd-c7e9-49a0-a657-146c5084524c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Returning 404 to user: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:51:33.095590 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0e446ebd-c7e9-49a0-a657-146c5084524c tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "DELETE /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 404 len: 111 microversion: 2.1 time: 0.058020 Jul 27 07:51:33.096369 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 171/335] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 07:51:33 2022] DELETE /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 07:51:33.108015 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3cbed9c2-f08c-4ff8-878b-192c18cee345 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:33.123443 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3cbed9c2-f08c-4ff8-878b-192c18cee345 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] [instance: 41f7e2e6-f10c-45e8-aacb-67a155d5da44] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:33.153793 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3cbed9c2-f08c-4ff8-878b-192c18cee345 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:33.154311 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3cbed9c2-f08c-4ff8-878b-192c18cee345 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:33.155178 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3cbed9c2-f08c-4ff8-878b-192c18cee345 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:33.155603 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3cbed9c2-f08c-4ff8-878b-192c18cee345 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:33.200631 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-3cbed9c2-f08c-4ff8-878b-192c18cee345 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] HTTP exception thrown: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3cbed9c2-f08c-4ff8-878b-192c18cee345 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Request method failure captured: Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 HTTP/1.1 Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O4XZJJTyy9FugIQZaeFOpo4WiUaWeMSzStVoRJciUKvQ8tzQTz-UwzmSlNNdkvvH688js-jaP0q5oQSeuHGp3QGnbYIeZZ7mvVAksJ7zh2xsn3d9iH6TSe7vpWAnsd-uwG4gEYaFwegrzhCK6ouSCqdI58HZHo-c8kFQ4uRHP_UJ48 Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 81e9270b6ae24d75b778de7e0ade50fc Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-DeleteServersTestJSON-1889476351 Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 07:51:33.203387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 07:51:33.205785 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81e9270b6ae24d75b778de7e0ade50fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_81e9270b6ae24d75b778de7e0ade50fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81e9270b6ae24d75b778de7e0ade50fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/81e9270b6ae24d75b778de7e0ade50fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:51:33.205785 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-DeleteServersTestJSON-1889476351 Jul 27 07:51:33.205785 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 81e9270b6ae24d75b778de7e0ade50fc Jul 27 07:51:33.205785 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-DeleteServersTestJSON-1889476351 Jul 27 07:51:33.205785 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-DeleteServersTestJSON-1889476351-project Jul 27 07:51:33.205785 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 07:51:33.205785 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 07:51:33.205785 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: be2d0a6b52c8465a8ae2f46d1270ae38 Jul 27 07:51:33.205785 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-DeleteServersTestJSON-1889476351-project Jul 27 07:51:33.205785 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 07:51:33.205785 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:33.205785 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': '41f7e2e6-f10c-45e8-aacb-67a155d5da44'} Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:51:33.206825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:51:33.207952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:51:33.207952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 07:51:33.207952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 07:51:33.207952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 07:51:33.207952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 07:51:33.207952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 07:51:33.207952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:51:33.207952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:33.207952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:33.207952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:51:33.207952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:33.207952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:51:33.207952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:51:33.207952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:51:33.207952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:51:33.207952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:51:33.207952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. Jul 27 07:51:33.207952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:51:33.210553 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3cbed9c2-f08c-4ff8-878b-192c18cee345 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] Returning 404 to user: Instance 41f7e2e6-f10c-45e8-aacb-67a155d5da44 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:51:33.211803 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3cbed9c2-f08c-4ff8-878b-192c18cee345 tempest-DeleteServersTestJSON-1889476351 tempest-DeleteServersTestJSON-1889476351-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44" status: 404 len: 111 microversion: 2.1 time: 0.109322 Jul 27 07:51:33.212921 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 172/336] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:33 2022] GET /compute/v2.1/servers/41f7e2e6-f10c-45e8-aacb-67a155d5da44 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 07:51:33.344654 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-64ca376a-3c1b-4087-a180-d9bfa68d39a7 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:33.359182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-64ca376a-3c1b-4087-a180-d9bfa68d39a7 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.362367 Jul 27 07:51:33.359896 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 165/337] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:32 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:34.389885 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e587b5b0-e9a6-4fde-9d17-7f55b11c7373 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:34.391305 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e587b5b0-e9a6-4fde-9d17-7f55b11c7373 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:34.399243 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e587b5b0-e9a6-4fde-9d17-7f55b11c7373 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:34.400207 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e587b5b0-e9a6-4fde-9d17-7f55b11c7373 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:34.401067 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e587b5b0-e9a6-4fde-9d17-7f55b11c7373 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:34.401577 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e587b5b0-e9a6-4fde-9d17-7f55b11c7373 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:34.646486 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e587b5b0-e9a6-4fde-9d17-7f55b11c7373 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:34.665366 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e587b5b0-e9a6-4fde-9d17-7f55b11c7373 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.277136 Jul 27 07:51:34.666515 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 173/338] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:34 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:35.690837 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0b9af323-ed8b-4526-aab2-0d5ee8d2b92c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:35.692233 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0b9af323-ed8b-4526-aab2-0d5ee8d2b92c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:35.708444 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0b9af323-ed8b-4526-aab2-0d5ee8d2b92c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:35.708924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0b9af323-ed8b-4526-aab2-0d5ee8d2b92c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:35.711761 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0b9af323-ed8b-4526-aab2-0d5ee8d2b92c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:35.712650 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0b9af323-ed8b-4526-aab2-0d5ee8d2b92c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:36.221952 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0b9af323-ed8b-4526-aab2-0d5ee8d2b92c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:36.226415 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=100 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:36.256923 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0b9af323-ed8b-4526-aab2-0d5ee8d2b92c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.569747 Jul 27 07:51:36.261380 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 166/339] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:35 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:37.293043 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-14098ef0-e9d8-4978-bf06-39c6521334bb tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:37.294369 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-14098ef0-e9d8-4978-bf06-39c6521334bb tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:37.306431 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14098ef0-e9d8-4978-bf06-39c6521334bb tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:37.307217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14098ef0-e9d8-4978-bf06-39c6521334bb tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:37.308117 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14098ef0-e9d8-4978-bf06-39c6521334bb tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:37.308664 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14098ef0-e9d8-4978-bf06-39c6521334bb tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:37.605690 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-14098ef0-e9d8-4978-bf06-39c6521334bb tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:37.617375 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-14098ef0-e9d8-4978-bf06-39c6521334bb tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.326898 Jul 27 07:51:37.631314 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 174/340] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:37 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:38.649347 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-6f51d2dc-08cf-497d-9a59-5e581725b402 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:38.650204 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-6f51d2dc-08cf-497d-9a59-5e581725b402 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:38.662334 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6f51d2dc-08cf-497d-9a59-5e581725b402 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:38.662790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6f51d2dc-08cf-497d-9a59-5e581725b402 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:38.663639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6f51d2dc-08cf-497d-9a59-5e581725b402 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:38.664082 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6f51d2dc-08cf-497d-9a59-5e581725b402 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:38.920303 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-6f51d2dc-08cf-497d-9a59-5e581725b402 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:38.928850 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-6f51d2dc-08cf-497d-9a59-5e581725b402 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.290701 Jul 27 07:51:38.929417 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 167/341] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:38 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:39.949679 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6b828d3e-7728-4d02-9c05-8cf8afbd0383 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:39.950296 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6b828d3e-7728-4d02-9c05-8cf8afbd0383 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:39.969694 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6b828d3e-7728-4d02-9c05-8cf8afbd0383 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:39.970146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6b828d3e-7728-4d02-9c05-8cf8afbd0383 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:39.973485 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6b828d3e-7728-4d02-9c05-8cf8afbd0383 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:39.975657 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6b828d3e-7728-4d02-9c05-8cf8afbd0383 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:40.340031 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6b828d3e-7728-4d02-9c05-8cf8afbd0383 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:40.355501 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6b828d3e-7728-4d02-9c05-8cf8afbd0383 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.409559 Jul 27 07:51:40.356236 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 175/342] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:39 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:41.377900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-07b42aad-7357-49ea-858a-53fe00f337df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:41.379472 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-07b42aad-7357-49ea-858a-53fe00f337df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:41.393175 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-07b42aad-7357-49ea-858a-53fe00f337df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:41.397578 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-07b42aad-7357-49ea-858a-53fe00f337df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:41.398397 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-07b42aad-7357-49ea-858a-53fe00f337df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:41.398838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-07b42aad-7357-49ea-858a-53fe00f337df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:41.682449 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-07b42aad-7357-49ea-858a-53fe00f337df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:41.696114 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-07b42aad-7357-49ea-858a-53fe00f337df tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.322560 Jul 27 07:51:41.696899 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 168/343] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:41 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:42.720175 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4d4d56c8-c503-4384-abe6-3245e89d82bf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:42.722576 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4d4d56c8-c503-4384-abe6-3245e89d82bf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:42.736461 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4d4d56c8-c503-4384-abe6-3245e89d82bf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:42.737115 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4d4d56c8-c503-4384-abe6-3245e89d82bf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:42.738728 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4d4d56c8-c503-4384-abe6-3245e89d82bf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:42.739767 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4d4d56c8-c503-4384-abe6-3245e89d82bf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:43.012003 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4d4d56c8-c503-4384-abe6-3245e89d82bf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:43.021219 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4d4d56c8-c503-4384-abe6-3245e89d82bf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.306401 Jul 27 07:51:43.023431 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 176/344] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:42 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:44.048589 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-4ef94b2a-9606-4fa9-baea-f6722c620918 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:44.049268 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-4ef94b2a-9606-4fa9-baea-f6722c620918 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:44.072553 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4ef94b2a-9606-4fa9-baea-f6722c620918 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:44.073008 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4ef94b2a-9606-4fa9-baea-f6722c620918 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:44.073801 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4ef94b2a-9606-4fa9-baea-f6722c620918 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:44.082395 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4ef94b2a-9606-4fa9-baea-f6722c620918 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:44.365307 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-4ef94b2a-9606-4fa9-baea-f6722c620918 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:44.378028 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-4ef94b2a-9606-4fa9-baea-f6722c620918 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.337014 Jul 27 07:51:44.380518 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 169/345] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:44 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:45.439338 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-85888d8f-6fec-4967-9336-e21458c977d1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:45.443134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-85888d8f-6fec-4967-9336-e21458c977d1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:45.469423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-85888d8f-6fec-4967-9336-e21458c977d1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:45.470904 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-85888d8f-6fec-4967-9336-e21458c977d1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:45.471819 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-85888d8f-6fec-4967-9336-e21458c977d1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:45.475212 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-85888d8f-6fec-4967-9336-e21458c977d1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:45.797407 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-85888d8f-6fec-4967-9336-e21458c977d1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:45.833333 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-85888d8f-6fec-4967-9336-e21458c977d1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.404170 Jul 27 07:51:45.846934 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 177/346] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:45 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:46.862635 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2ba21657-3335-4e2e-adfc-b7127670fc9f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:46.864262 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2ba21657-3335-4e2e-adfc-b7127670fc9f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:46.872733 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2ba21657-3335-4e2e-adfc-b7127670fc9f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:46.873437 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2ba21657-3335-4e2e-adfc-b7127670fc9f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:46.874624 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2ba21657-3335-4e2e-adfc-b7127670fc9f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:46.877983 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2ba21657-3335-4e2e-adfc-b7127670fc9f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:47.098096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2ba21657-3335-4e2e-adfc-b7127670fc9f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:47.109332 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2ba21657-3335-4e2e-adfc-b7127670fc9f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1523 microversion: 2.1 time: 0.254138 Jul 27 07:51:47.124657 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 170/347] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:46 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:48.131061 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ba01fd7c-f687-4744-afe6-53d766bdf9e1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:48.132357 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ba01fd7c-f687-4744-afe6-53d766bdf9e1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:48.139531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ba01fd7c-f687-4744-afe6-53d766bdf9e1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:48.140210 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ba01fd7c-f687-4744-afe6-53d766bdf9e1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:48.141164 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ba01fd7c-f687-4744-afe6-53d766bdf9e1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:48.141765 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ba01fd7c-f687-4744-afe6-53d766bdf9e1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:48.365267 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ba01fd7c-f687-4744-afe6-53d766bdf9e1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:48.374348 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ba01fd7c-f687-4744-afe6-53d766bdf9e1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1503 microversion: 2.1 time: 0.247140 Jul 27 07:51:48.387390 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 178/348] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:48 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1503 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:48.399696 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ad5d1ec7-54eb-405d-869d-a489dac37fbf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:48.401817 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ad5d1ec7-54eb-405d-869d-a489dac37fbf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:48.410317 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ad5d1ec7-54eb-405d-869d-a489dac37fbf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:48.411621 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ad5d1ec7-54eb-405d-869d-a489dac37fbf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:48.412691 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ad5d1ec7-54eb-405d-869d-a489dac37fbf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:48.413242 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ad5d1ec7-54eb-405d-869d-a489dac37fbf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:48.589376 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ad5d1ec7-54eb-405d-869d-a489dac37fbf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:48.603331 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ad5d1ec7-54eb-405d-869d-a489dac37fbf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1516 microversion: 2.1 time: 0.211226 Jul 27 07:51:48.604229 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 171/349] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:48 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1516 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:52.285667 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7189af82-57ac-462b-9dd2-ea7aae1e6d5c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:51:52.289078 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7189af82-57ac-462b-9dd2-ea7aae1e6d5c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:52.296227 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7189af82-57ac-462b-9dd2-ea7aae1e6d5c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:52.297212 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7189af82-57ac-462b-9dd2-ea7aae1e6d5c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:52.298097 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7189af82-57ac-462b-9dd2-ea7aae1e6d5c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:52.298655 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7189af82-57ac-462b-9dd2-ea7aae1e6d5c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:52.323874 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-7189af82-57ac-462b-9dd2-ea7aae1e6d5c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lazy-loading 'flavor' on Instance uuid 0d14cae7-2ec9-4ab1-94c5-b63982ffc251 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:51:52.466754 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7189af82-57ac-462b-9dd2-ea7aae1e6d5c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "POST /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251/action" status: 200 len: 32 microversion: 2.1 time: 0.185785 Jul 27 07:51:52.467767 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 179/350] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Jul 27 07:51:52 2022] POST /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 07:51:52.477511 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e4000fe4-dee6-4e6c-9696-1598789c885f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:52.478136 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e4000fe4-dee6-4e6c-9696-1598789c885f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:52.480281 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=46 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:52.495044 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e4000fe4-dee6-4e6c-9696-1598789c885f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:52.495823 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e4000fe4-dee6-4e6c-9696-1598789c885f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:52.497065 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e4000fe4-dee6-4e6c-9696-1598789c885f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:52.497935 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e4000fe4-dee6-4e6c-9696-1598789c885f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:52.776698 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e4000fe4-dee6-4e6c-9696-1598789c885f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:52.786564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e4000fe4-dee6-4e6c-9696-1598789c885f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.313330 Jul 27 07:51:52.788788 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 172/351] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:52 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:53.815332 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9be693bc-c149-433e-9c32-d90eda5589cc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:53.816650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9be693bc-c149-433e-9c32-d90eda5589cc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:53.827582 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9be693bc-c149-433e-9c32-d90eda5589cc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:53.828041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9be693bc-c149-433e-9c32-d90eda5589cc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:53.828833 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9be693bc-c149-433e-9c32-d90eda5589cc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:53.829276 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9be693bc-c149-433e-9c32-d90eda5589cc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:53.975214 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9be693bc-c149-433e-9c32-d90eda5589cc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:53.985537 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9be693bc-c149-433e-9c32-d90eda5589cc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.179477 Jul 27 07:51:53.986521 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 180/352] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:53 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:55.008573 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-3e400361-bda0-4f75-883d-49658ca6ab39 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:55.009829 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-3e400361-bda0-4f75-883d-49658ca6ab39 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:55.016171 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3e400361-bda0-4f75-883d-49658ca6ab39 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:55.016626 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3e400361-bda0-4f75-883d-49658ca6ab39 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:55.017398 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3e400361-bda0-4f75-883d-49658ca6ab39 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:55.017834 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3e400361-bda0-4f75-883d-49658ca6ab39 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:55.170295 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3e400361-bda0-4f75-883d-49658ca6ab39 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:55.178295 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-3e400361-bda0-4f75-883d-49658ca6ab39 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.173813 Jul 27 07:51:55.179257 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 173/353] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:55 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:56.200949 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f36d21a9-baba-4aeb-adef-278c70b3fcb4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:56.202352 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f36d21a9-baba-4aeb-adef-278c70b3fcb4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:56.209923 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f36d21a9-baba-4aeb-adef-278c70b3fcb4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:56.210735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f36d21a9-baba-4aeb-adef-278c70b3fcb4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:56.211771 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f36d21a9-baba-4aeb-adef-278c70b3fcb4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:56.212444 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f36d21a9-baba-4aeb-adef-278c70b3fcb4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:56.236397 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:56.364916 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f36d21a9-baba-4aeb-adef-278c70b3fcb4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:56.373166 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f36d21a9-baba-4aeb-adef-278c70b3fcb4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.176178 Jul 27 07:51:56.374117 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 181/354] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:56 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:51:56.490231 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-33c50324-0880-4b00-8d90-df46d9683a16 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Action: 'create', calling method: .version_select at 0x7f19fe5cbca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2001526534", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVxdPyoAWWQG89jKJGtGH2wCN56wGx7qsGnoTT3NZf1QD9ecnuZeVYXHZ1AU7Zs6Yh50fgwpTIc7EorwntPjPutA4ZXpe7Ifg6GLLPrSTCOHrCibjv68D4LBJW5IxRbeQ=="}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:51:56.505333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-33c50324-0880-4b00-8d90-df46d9683a16 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Getting quotas for project 4271996d22bc4364a5554c0fbff0378b. Resources: {'key_pairs'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:51:56.509147 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-33c50324-0880-4b00-8d90-df46d9683a16 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Getting quotas for user 08692d3eaab8431f8af3da2c1e098ec3 and project 4271996d22bc4364a5554c0fbff0378b. Resources: {'key_pairs'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:51:56.531031 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-33c50324-0880-4b00-8d90-df46d9683a16 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.044630 Jul 27 07:51:56.531617 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 174/355] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Jul 27 07:51:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:51:56.632489 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-234d98f2-ed65-40e2-8692-09d0449c861a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-600799837", "imageRef": "47c8a630-e103-427c-b343-18e686cf46ab", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2001526534", "networks": [{"uuid": "94432f8c-40af-4a71-b5b3-c8d157a13c39"}]}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:51:56.682968 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.network.neutron [None req-234d98f2-ed65-40e2-8692-09d0449c861a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] validate_networks() for [('94432f8c-40af-4a71-b5b3-c8d157a13c39', None, None, None, None, None)] {{(pid=117780) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:51:57.052591 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-234d98f2-ed65-40e2-8692-09d0449c861a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Flavor limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:51:57.053021 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-234d98f2-ed65-40e2-8692-09d0449c861a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Image limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:51:57.053489 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-234d98f2-ed65-40e2-8692-09d0449c861a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Flavor pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:51:57.053892 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-234d98f2-ed65-40e2-8692-09d0449c861a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Image pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:51:57.054325 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-234d98f2-ed65-40e2-8692-09d0449c861a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:51:57.063155 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-234d98f2-ed65-40e2-8692-09d0449c861a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:57.063597 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-234d98f2-ed65-40e2-8692-09d0449c861a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:57.064382 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-234d98f2-ed65-40e2-8692-09d0449c861a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:57.064811 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-234d98f2-ed65-40e2-8692-09d0449c861a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:57.081840 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-234d98f2-ed65-40e2-8692-09d0449c861a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Getting quotas for project 4271996d22bc4364a5554c0fbff0378b. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:51:57.085844 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-234d98f2-ed65-40e2-8692-09d0449c861a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Getting quotas for user 08692d3eaab8431f8af3da2c1e098ec3 and project 4271996d22bc4364a5554c0fbff0378b. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:51:57.096460 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-234d98f2-ed65-40e2-8692-09d0449c861a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Going to run 1 instances... {{(pid=117780) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:51:57.098689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-234d98f2-ed65-40e2-8692-09d0449c861a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47c8a630-e103-427c-b343-18e686cf46ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:51:57.148279 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-234d98f2-ed65-40e2-8692-09d0449c861a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519847 Jul 27 07:51:57.154354 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 182/356] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 07:51:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 07:51:57.160653 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-becfa333-8b1c-4d2d-92c7-aa18d7d74474 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:57.161457 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-becfa333-8b1c-4d2d-92c7-aa18d7d74474 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:57.216227 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-becfa333-8b1c-4d2d-92c7-aa18d7d74474 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:57.223178 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-becfa333-8b1c-4d2d-92c7-aa18d7d74474 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1258 microversion: 2.1 time: 0.067300 Jul 27 07:51:57.223992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 175/357] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:57 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:57.397270 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7b56eb23-1c79-4c81-bc1b-814ae3b75ae0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:57.397929 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7b56eb23-1c79-4c81-bc1b-814ae3b75ae0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:57.405472 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7b56eb23-1c79-4c81-bc1b-814ae3b75ae0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:57.405929 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7b56eb23-1c79-4c81-bc1b-814ae3b75ae0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:57.406711 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7b56eb23-1c79-4c81-bc1b-814ae3b75ae0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:57.407176 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7b56eb23-1c79-4c81-bc1b-814ae3b75ae0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:57.547525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7b56eb23-1c79-4c81-bc1b-814ae3b75ae0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:57.556695 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7b56eb23-1c79-4c81-bc1b-814ae3b75ae0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.163769 Jul 27 07:51:57.557381 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 183/358] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:57 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:58.243505 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-cde95116-b6c6-4819-b771-3f8fdc9ac3ca tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:58.244121 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-cde95116-b6c6-4819-b771-3f8fdc9ac3ca tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:58.251262 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cde95116-b6c6-4819-b771-3f8fdc9ac3ca tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:58.251708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cde95116-b6c6-4819-b771-3f8fdc9ac3ca tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:58.252477 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cde95116-b6c6-4819-b771-3f8fdc9ac3ca tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:58.253520 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cde95116-b6c6-4819-b771-3f8fdc9ac3ca tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:58.319897 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-cde95116-b6c6-4819-b771-3f8fdc9ac3ca tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:58.327425 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-cde95116-b6c6-4819-b771-3f8fdc9ac3ca tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1262 microversion: 2.1 time: 0.087686 Jul 27 07:51:58.327984 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 176/359] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:58 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1262 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:58.578794 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-79882b0d-a656-43f5-8f68-2b4ee0744d0b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:58.579466 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-79882b0d-a656-43f5-8f68-2b4ee0744d0b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:58.581753 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:51:58.588344 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-79882b0d-a656-43f5-8f68-2b4ee0744d0b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:58.589022 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-79882b0d-a656-43f5-8f68-2b4ee0744d0b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:58.590217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-79882b0d-a656-43f5-8f68-2b4ee0744d0b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:58.590924 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-79882b0d-a656-43f5-8f68-2b4ee0744d0b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:58.735568 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-79882b0d-a656-43f5-8f68-2b4ee0744d0b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:58.743490 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-79882b0d-a656-43f5-8f68-2b4ee0744d0b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.168486 Jul 27 07:51:58.744055 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 184/360] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:58 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:59.348612 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-6d665b70-6d73-43b4-becb-a45619fcebe3 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:59.349469 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-6d665b70-6d73-43b4-becb-a45619fcebe3 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:59.355952 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6d665b70-6d73-43b4-becb-a45619fcebe3 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:59.356364 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6d665b70-6d73-43b4-becb-a45619fcebe3 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:59.357115 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6d665b70-6d73-43b4-becb-a45619fcebe3 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:59.357542 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6d665b70-6d73-43b4-becb-a45619fcebe3 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:59.417428 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-6d665b70-6d73-43b4-becb-a45619fcebe3 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:59.425206 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-6d665b70-6d73-43b4-becb-a45619fcebe3 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1310 microversion: 2.1 time: 0.080464 Jul 27 07:51:59.425763 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 177/361] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:59 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:51:59.764646 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-abd81ae3-9790-4868-9444-20390d324288 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:51:59.765211 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-abd81ae3-9790-4868-9444-20390d324288 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:51:59.773193 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abd81ae3-9790-4868-9444-20390d324288 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:59.773795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abd81ae3-9790-4868-9444-20390d324288 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:59.774571 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abd81ae3-9790-4868-9444-20390d324288 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:51:59.775034 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abd81ae3-9790-4868-9444-20390d324288 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:51:59.938477 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-abd81ae3-9790-4868-9444-20390d324288 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:51:59.948167 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-abd81ae3-9790-4868-9444-20390d324288 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.187348 Jul 27 07:51:59.948751 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 185/362] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:51:59 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:00.448370 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b3920054-3094-41f3-b92a-d18bb4957635 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:00.450124 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b3920054-3094-41f3-b92a-d18bb4957635 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:00.475560 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b3920054-3094-41f3-b92a-d18bb4957635 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:00.476324 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b3920054-3094-41f3-b92a-d18bb4957635 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:00.477706 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b3920054-3094-41f3-b92a-d18bb4957635 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:00.478448 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b3920054-3094-41f3-b92a-d18bb4957635 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:00.596855 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b3920054-3094-41f3-b92a-d18bb4957635 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:00.607714 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b3920054-3094-41f3-b92a-d18bb4957635 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1316 microversion: 2.1 time: 0.164177 Jul 27 07:52:00.608854 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 178/363] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:00 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:00.975675 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2fe8103d-45a7-4278-b71e-cdcb40e2e39d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:00.976704 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2fe8103d-45a7-4278-b71e-cdcb40e2e39d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:00.985375 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2fe8103d-45a7-4278-b71e-cdcb40e2e39d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:00.985972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2fe8103d-45a7-4278-b71e-cdcb40e2e39d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:00.987011 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2fe8103d-45a7-4278-b71e-cdcb40e2e39d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:00.987697 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2fe8103d-45a7-4278-b71e-cdcb40e2e39d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:01.161016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2fe8103d-45a7-4278-b71e-cdcb40e2e39d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:01.172774 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2fe8103d-45a7-4278-b71e-cdcb40e2e39d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.203154 Jul 27 07:52:01.173875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 186/364] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:00 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:01.630229 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ff5d0511-9fd7-4dfc-b41d-638707483461 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:01.631579 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ff5d0511-9fd7-4dfc-b41d-638707483461 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:01.638553 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ff5d0511-9fd7-4dfc-b41d-638707483461 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:01.639152 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ff5d0511-9fd7-4dfc-b41d-638707483461 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:01.639801 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ff5d0511-9fd7-4dfc-b41d-638707483461 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:01.640231 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ff5d0511-9fd7-4dfc-b41d-638707483461 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:01.778755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ff5d0511-9fd7-4dfc-b41d-638707483461 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:01.786509 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ff5d0511-9fd7-4dfc-b41d-638707483461 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.160651 Jul 27 07:52:01.787175 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 179/365] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:01 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:02.200705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2a095e7b-ec9b-4b84-8621-8c0aea043a74 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:02.201427 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2a095e7b-ec9b-4b84-8621-8c0aea043a74 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:02.230460 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2a095e7b-ec9b-4b84-8621-8c0aea043a74 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:02.230932 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2a095e7b-ec9b-4b84-8621-8c0aea043a74 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:02.231910 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2a095e7b-ec9b-4b84-8621-8c0aea043a74 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:02.232355 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2a095e7b-ec9b-4b84-8621-8c0aea043a74 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:02.465455 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2a095e7b-ec9b-4b84-8621-8c0aea043a74 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:02.473126 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2a095e7b-ec9b-4b84-8621-8c0aea043a74 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.277070 Jul 27 07:52:02.474506 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 187/366] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:02 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:02.807569 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-aa3951f3-4148-4435-a4d1-416f013c23ba tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:02.808888 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-aa3951f3-4148-4435-a4d1-416f013c23ba tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:02.815765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aa3951f3-4148-4435-a4d1-416f013c23ba tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:02.816504 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aa3951f3-4148-4435-a4d1-416f013c23ba tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:02.817489 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aa3951f3-4148-4435-a4d1-416f013c23ba tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:02.818144 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aa3951f3-4148-4435-a4d1-416f013c23ba tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:02.988091 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-aa3951f3-4148-4435-a4d1-416f013c23ba tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:02.996836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-aa3951f3-4148-4435-a4d1-416f013c23ba tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.192952 Jul 27 07:52:02.997489 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 180/367] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:02 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:03.505565 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-54505638-8ed4-45f5-aad7-caea4cf24688 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:03.507058 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-54505638-8ed4-45f5-aad7-caea4cf24688 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:03.524190 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-54505638-8ed4-45f5-aad7-caea4cf24688 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:03.524745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-54505638-8ed4-45f5-aad7-caea4cf24688 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:03.525586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-54505638-8ed4-45f5-aad7-caea4cf24688 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:03.526018 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-54505638-8ed4-45f5-aad7-caea4cf24688 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:03.747669 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-54505638-8ed4-45f5-aad7-caea4cf24688 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:03.755501 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-54505638-8ed4-45f5-aad7-caea4cf24688 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.253767 Jul 27 07:52:03.756635 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 188/368] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:03 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:04.017710 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-38e694f2-c74d-43b2-afb3-f1fff36300c0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:04.018680 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-38e694f2-c74d-43b2-afb3-f1fff36300c0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:04.026712 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-38e694f2-c74d-43b2-afb3-f1fff36300c0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:04.028315 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-38e694f2-c74d-43b2-afb3-f1fff36300c0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:04.029737 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-38e694f2-c74d-43b2-afb3-f1fff36300c0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:04.030410 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-38e694f2-c74d-43b2-afb3-f1fff36300c0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:04.310656 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-38e694f2-c74d-43b2-afb3-f1fff36300c0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:04.321208 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-38e694f2-c74d-43b2-afb3-f1fff36300c0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.307077 Jul 27 07:52:04.322684 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 181/369] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:04 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:04.790726 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-90a562fc-d063-455a-a705-b7cb34faaa68 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:04.791424 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-90a562fc-d063-455a-a705-b7cb34faaa68 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:04.797891 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-90a562fc-d063-455a-a705-b7cb34faaa68 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:04.798343 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-90a562fc-d063-455a-a705-b7cb34faaa68 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:04.799137 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-90a562fc-d063-455a-a705-b7cb34faaa68 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:04.799576 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-90a562fc-d063-455a-a705-b7cb34faaa68 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:04.952101 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-90a562fc-d063-455a-a705-b7cb34faaa68 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:04.960007 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-90a562fc-d063-455a-a705-b7cb34faaa68 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.174009 Jul 27 07:52:04.960835 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 189/370] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:04 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:05.345522 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ca90f8f4-cf77-4e18-b07d-e7de12dacb24 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:05.349166 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ca90f8f4-cf77-4e18-b07d-e7de12dacb24 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:05.357137 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ca90f8f4-cf77-4e18-b07d-e7de12dacb24 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:05.357931 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ca90f8f4-cf77-4e18-b07d-e7de12dacb24 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:05.358785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ca90f8f4-cf77-4e18-b07d-e7de12dacb24 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:05.359333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ca90f8f4-cf77-4e18-b07d-e7de12dacb24 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:05.607620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ca90f8f4-cf77-4e18-b07d-e7de12dacb24 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:05.618100 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ca90f8f4-cf77-4e18-b07d-e7de12dacb24 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.276480 Jul 27 07:52:05.619634 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 182/371] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:05 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:05.981184 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-817c0f2d-a014-4773-9629-fe56ba964ce8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:05.981809 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-817c0f2d-a014-4773-9629-fe56ba964ce8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:05.988541 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-817c0f2d-a014-4773-9629-fe56ba964ce8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:05.988982 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-817c0f2d-a014-4773-9629-fe56ba964ce8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:05.989755 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-817c0f2d-a014-4773-9629-fe56ba964ce8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:05.990206 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-817c0f2d-a014-4773-9629-fe56ba964ce8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:06.128124 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-817c0f2d-a014-4773-9629-fe56ba964ce8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:06.135814 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-817c0f2d-a014-4773-9629-fe56ba964ce8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.158486 Jul 27 07:52:06.136381 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 190/372] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:05 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:06.642009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-52f09645-1b55-4efe-82b2-85ae7e444ba2 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:06.643999 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-52f09645-1b55-4efe-82b2-85ae7e444ba2 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:06.652694 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-52f09645-1b55-4efe-82b2-85ae7e444ba2 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:06.654092 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-52f09645-1b55-4efe-82b2-85ae7e444ba2 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:06.655124 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-52f09645-1b55-4efe-82b2-85ae7e444ba2 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:06.656117 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-52f09645-1b55-4efe-82b2-85ae7e444ba2 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:06.660850 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=86 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:06.868567 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-52f09645-1b55-4efe-82b2-85ae7e444ba2 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:06.876859 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-52f09645-1b55-4efe-82b2-85ae7e444ba2 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.239415 Jul 27 07:52:06.877811 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 183/373] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:06 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:07.157315 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0ba68766-8660-4186-8397-548201fdb937 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:07.157935 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0ba68766-8660-4186-8397-548201fdb937 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:07.164424 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:07.165099 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=6 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:07.167063 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0ba68766-8660-4186-8397-548201fdb937 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:07.167495 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0ba68766-8660-4186-8397-548201fdb937 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:07.168361 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0ba68766-8660-4186-8397-548201fdb937 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:07.168863 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0ba68766-8660-4186-8397-548201fdb937 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:07.334843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0ba68766-8660-4186-8397-548201fdb937 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:07.345280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0ba68766-8660-4186-8397-548201fdb937 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.192285 Jul 27 07:52:07.356541 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 191/374] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:07 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:07.899149 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d43240d9-201c-4514-aeb0-a2b521b63faf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:07.899809 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d43240d9-201c-4514-aeb0-a2b521b63faf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:07.901615 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=6 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:07.906980 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d43240d9-201c-4514-aeb0-a2b521b63faf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:07.907424 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d43240d9-201c-4514-aeb0-a2b521b63faf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:07.908375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d43240d9-201c-4514-aeb0-a2b521b63faf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:07.908811 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d43240d9-201c-4514-aeb0-a2b521b63faf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:08.041635 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d43240d9-201c-4514-aeb0-a2b521b63faf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:08.050913 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d43240d9-201c-4514-aeb0-a2b521b63faf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.156088 Jul 27 07:52:08.051653 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 184/375] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:07 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:08.369943 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f7ccec88-c31f-4525-8d48-10ce8fd26ad2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:08.370753 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f7ccec88-c31f-4525-8d48-10ce8fd26ad2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:08.377408 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f7ccec88-c31f-4525-8d48-10ce8fd26ad2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:08.378077 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f7ccec88-c31f-4525-8d48-10ce8fd26ad2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:08.378858 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f7ccec88-c31f-4525-8d48-10ce8fd26ad2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:08.379323 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f7ccec88-c31f-4525-8d48-10ce8fd26ad2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:08.525519 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f7ccec88-c31f-4525-8d48-10ce8fd26ad2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:08.533764 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f7ccec88-c31f-4525-8d48-10ce8fd26ad2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.168041 Jul 27 07:52:08.534549 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 192/376] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:08 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:09.073314 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-4aed90b4-3925-469c-921c-20fdade6bfdb tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:09.074568 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-4aed90b4-3925-469c-921c-20fdade6bfdb tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:09.080672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4aed90b4-3925-469c-921c-20fdade6bfdb tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:09.081123 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4aed90b4-3925-469c-921c-20fdade6bfdb tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:09.081890 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4aed90b4-3925-469c-921c-20fdade6bfdb tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:09.082326 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4aed90b4-3925-469c-921c-20fdade6bfdb tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:09.231899 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-4aed90b4-3925-469c-921c-20fdade6bfdb tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:09.239539 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-4aed90b4-3925-469c-921c-20fdade6bfdb tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.170086 Jul 27 07:52:09.240104 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 185/377] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:09 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:09.555765 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-66862524-7727-400e-8cb4-751d8a81a2e3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:09.556826 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-66862524-7727-400e-8cb4-751d8a81a2e3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:09.564026 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-66862524-7727-400e-8cb4-751d8a81a2e3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:09.564760 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-66862524-7727-400e-8cb4-751d8a81a2e3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:09.565786 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-66862524-7727-400e-8cb4-751d8a81a2e3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:09.566324 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-66862524-7727-400e-8cb4-751d8a81a2e3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:09.709791 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-66862524-7727-400e-8cb4-751d8a81a2e3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:09.718014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-66862524-7727-400e-8cb4-751d8a81a2e3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.166469 Jul 27 07:52:09.731258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 193/378] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:09 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:10.264130 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-aac27291-4a2f-4531-b6d7-f421c456945a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:10.264861 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-aac27291-4a2f-4531-b6d7-f421c456945a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:10.271476 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aac27291-4a2f-4531-b6d7-f421c456945a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:10.272259 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aac27291-4a2f-4531-b6d7-f421c456945a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:10.273140 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aac27291-4a2f-4531-b6d7-f421c456945a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:10.273768 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aac27291-4a2f-4531-b6d7-f421c456945a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:10.445115 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-aac27291-4a2f-4531-b6d7-f421c456945a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:10.453151 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-aac27291-4a2f-4531-b6d7-f421c456945a tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.196655 Jul 27 07:52:10.453726 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 186/379] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:10 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:10.739238 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-78006699-f9ea-4363-8776-d63a15441ecc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:10.739857 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-78006699-f9ea-4363-8776-d63a15441ecc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:10.747138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-78006699-f9ea-4363-8776-d63a15441ecc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:10.747596 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-78006699-f9ea-4363-8776-d63a15441ecc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:10.748401 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-78006699-f9ea-4363-8776-d63a15441ecc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:10.748842 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-78006699-f9ea-4363-8776-d63a15441ecc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:10.886847 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-78006699-f9ea-4363-8776-d63a15441ecc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:10.894803 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-78006699-f9ea-4363-8776-d63a15441ecc tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.159305 Jul 27 07:52:10.895409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 194/380] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:10 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:11.473972 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b5410083-612f-4b8d-9c6c-46e4e6d05ecc tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:11.476433 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b5410083-612f-4b8d-9c6c-46e4e6d05ecc tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:11.484347 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b5410083-612f-4b8d-9c6c-46e4e6d05ecc tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:11.484937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b5410083-612f-4b8d-9c6c-46e4e6d05ecc tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:11.485743 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b5410083-612f-4b8d-9c6c-46e4e6d05ecc tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:11.486310 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b5410083-612f-4b8d-9c6c-46e4e6d05ecc tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:11.641898 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b5410083-612f-4b8d-9c6c-46e4e6d05ecc tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:11.650909 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b5410083-612f-4b8d-9c6c-46e4e6d05ecc tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.181093 Jul 27 07:52:11.651617 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 187/381] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:11 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:11.917967 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-55dab37b-a943-4ed9-aca2-490ce59c089e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:11.918529 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-55dab37b-a943-4ed9-aca2-490ce59c089e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:11.925646 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55dab37b-a943-4ed9-aca2-490ce59c089e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:11.926102 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55dab37b-a943-4ed9-aca2-490ce59c089e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:11.926914 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55dab37b-a943-4ed9-aca2-490ce59c089e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:11.927376 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55dab37b-a943-4ed9-aca2-490ce59c089e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:12.070472 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-55dab37b-a943-4ed9-aca2-490ce59c089e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:12.079412 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-55dab37b-a943-4ed9-aca2-490ce59c089e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.165435 Jul 27 07:52:12.080008 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 195/382] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:11 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:12.672938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-056cf109-722d-459a-b265-f35ffa674ff0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:12.673540 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-056cf109-722d-459a-b265-f35ffa674ff0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:12.680375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-056cf109-722d-459a-b265-f35ffa674ff0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:12.681178 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-056cf109-722d-459a-b265-f35ffa674ff0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:12.682184 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-056cf109-722d-459a-b265-f35ffa674ff0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:12.682609 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-056cf109-722d-459a-b265-f35ffa674ff0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:12.830624 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-056cf109-722d-459a-b265-f35ffa674ff0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:12.839831 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-056cf109-722d-459a-b265-f35ffa674ff0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.170971 Jul 27 07:52:12.840403 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 188/383] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:12 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:13.100241 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3141579c-a3e0-422d-9bde-ba446bb6047d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:13.100875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3141579c-a3e0-422d-9bde-ba446bb6047d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:13.107422 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3141579c-a3e0-422d-9bde-ba446bb6047d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:13.107869 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3141579c-a3e0-422d-9bde-ba446bb6047d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:13.108639 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3141579c-a3e0-422d-9bde-ba446bb6047d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:13.109074 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3141579c-a3e0-422d-9bde-ba446bb6047d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:13.244895 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3141579c-a3e0-422d-9bde-ba446bb6047d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:13.252813 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3141579c-a3e0-422d-9bde-ba446bb6047d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.156716 Jul 27 07:52:13.253396 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 196/384] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:13 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:13.861974 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-16ff4bb4-43ee-44be-9cb3-e74c2dc45f98 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:13.862824 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-16ff4bb4-43ee-44be-9cb3-e74c2dc45f98 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:13.887163 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-16ff4bb4-43ee-44be-9cb3-e74c2dc45f98 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:13.887163 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-16ff4bb4-43ee-44be-9cb3-e74c2dc45f98 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:13.887163 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-16ff4bb4-43ee-44be-9cb3-e74c2dc45f98 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:13.887163 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-16ff4bb4-43ee-44be-9cb3-e74c2dc45f98 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:14.035239 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-16ff4bb4-43ee-44be-9cb3-e74c2dc45f98 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:14.043713 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-16ff4bb4-43ee-44be-9cb3-e74c2dc45f98 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.185718 Jul 27 07:52:14.044409 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 189/385] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:13 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:14.280219 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-99d31191-4ac2-42ef-83cf-81c471a8aae3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:14.280766 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-99d31191-4ac2-42ef-83cf-81c471a8aae3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:14.287719 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-99d31191-4ac2-42ef-83cf-81c471a8aae3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:14.288161 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-99d31191-4ac2-42ef-83cf-81c471a8aae3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:14.288914 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-99d31191-4ac2-42ef-83cf-81c471a8aae3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:14.289341 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-99d31191-4ac2-42ef-83cf-81c471a8aae3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:14.433208 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-99d31191-4ac2-42ef-83cf-81c471a8aae3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:14.440810 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-99d31191-4ac2-42ef-83cf-81c471a8aae3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.164615 Jul 27 07:52:14.441372 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 197/386] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:14 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:15.066617 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-770aa4ba-8959-4c5b-ae22-0082cc8361bf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:15.067334 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-770aa4ba-8959-4c5b-ae22-0082cc8361bf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:15.073861 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-770aa4ba-8959-4c5b-ae22-0082cc8361bf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:15.074302 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-770aa4ba-8959-4c5b-ae22-0082cc8361bf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:15.075102 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-770aa4ba-8959-4c5b-ae22-0082cc8361bf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:15.075537 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-770aa4ba-8959-4c5b-ae22-0082cc8361bf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:15.210405 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-770aa4ba-8959-4c5b-ae22-0082cc8361bf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:15.217818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-770aa4ba-8959-4c5b-ae22-0082cc8361bf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.155033 Jul 27 07:52:15.218379 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 190/387] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:15 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:15.461762 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3eb63543-47a9-44ac-8857-995c5533e87c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:15.462405 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3eb63543-47a9-44ac-8857-995c5533e87c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:15.468940 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3eb63543-47a9-44ac-8857-995c5533e87c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:15.469388 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3eb63543-47a9-44ac-8857-995c5533e87c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:15.470173 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3eb63543-47a9-44ac-8857-995c5533e87c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:15.470617 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3eb63543-47a9-44ac-8857-995c5533e87c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:15.603347 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3eb63543-47a9-44ac-8857-995c5533e87c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:15.607254 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:15.612436 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3eb63543-47a9-44ac-8857-995c5533e87c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.154631 Jul 27 07:52:15.613010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 198/388] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:15 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:16.239172 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-169d7f95-8fe3-482c-bf59-3a1943509dd1 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:16.239771 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-169d7f95-8fe3-482c-bf59-3a1943509dd1 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:16.245762 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-169d7f95-8fe3-482c-bf59-3a1943509dd1 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:16.246181 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-169d7f95-8fe3-482c-bf59-3a1943509dd1 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:16.246955 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-169d7f95-8fe3-482c-bf59-3a1943509dd1 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:16.247377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-169d7f95-8fe3-482c-bf59-3a1943509dd1 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:16.379305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-169d7f95-8fe3-482c-bf59-3a1943509dd1 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:16.387161 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-169d7f95-8fe3-482c-bf59-3a1943509dd1 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.151776 Jul 27 07:52:16.387651 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 191/389] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:16 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:16.634552 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d2298fc4-4d76-4dc4-b86b-9fd79b2fbb74 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:16.635221 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d2298fc4-4d76-4dc4-b86b-9fd79b2fbb74 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:16.641778 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d2298fc4-4d76-4dc4-b86b-9fd79b2fbb74 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:16.642169 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d2298fc4-4d76-4dc4-b86b-9fd79b2fbb74 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:16.642967 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d2298fc4-4d76-4dc4-b86b-9fd79b2fbb74 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:16.643409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d2298fc4-4d76-4dc4-b86b-9fd79b2fbb74 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:16.770669 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d2298fc4-4d76-4dc4-b86b-9fd79b2fbb74 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:16.778149 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d2298fc4-4d76-4dc4-b86b-9fd79b2fbb74 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.148126 Jul 27 07:52:16.778716 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 199/390] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:16 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:17.408405 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a0f93907-a32d-4b6c-bc3e-20d937fa50a4 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:17.409041 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a0f93907-a32d-4b6c-bc3e-20d937fa50a4 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:17.415165 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a0f93907-a32d-4b6c-bc3e-20d937fa50a4 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:17.415609 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a0f93907-a32d-4b6c-bc3e-20d937fa50a4 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:17.416370 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a0f93907-a32d-4b6c-bc3e-20d937fa50a4 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:17.416802 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a0f93907-a32d-4b6c-bc3e-20d937fa50a4 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:17.553452 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a0f93907-a32d-4b6c-bc3e-20d937fa50a4 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:17.560934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a0f93907-a32d-4b6c-bc3e-20d937fa50a4 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.156412 Jul 27 07:52:17.561492 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 192/391] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:17 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:52:17.798802 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-36bfaf52-f03a-4802-9d50-f63f0856d468 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:17.799345 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-36bfaf52-f03a-4802-9d50-f63f0856d468 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:17.806801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-36bfaf52-f03a-4802-9d50-f63f0856d468 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:17.807288 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-36bfaf52-f03a-4802-9d50-f63f0856d468 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:17.808078 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-36bfaf52-f03a-4802-9d50-f63f0856d468 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:17.808523 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-36bfaf52-f03a-4802-9d50-f63f0856d468 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:17.948734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-36bfaf52-f03a-4802-9d50-f63f0856d468 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:17.956206 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-36bfaf52-f03a-4802-9d50-f63f0856d468 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.161507 Jul 27 07:52:17.956765 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 200/392] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:17 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:52:18.581370 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-852f240d-29c1-4333-9073-56ad585f850e tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:18.581986 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-852f240d-29c1-4333-9073-56ad585f850e tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:18.588184 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-852f240d-29c1-4333-9073-56ad585f850e tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:18.588633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-852f240d-29c1-4333-9073-56ad585f850e tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:18.589395 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-852f240d-29c1-4333-9073-56ad585f850e tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:18.589827 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-852f240d-29c1-4333-9073-56ad585f850e tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:18.720530 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-852f240d-29c1-4333-9073-56ad585f850e tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:18.728693 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-852f240d-29c1-4333-9073-56ad585f850e tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.151087 Jul 27 07:52:18.729255 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 193/393] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:18 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:18.978074 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c5753987-dc58-49bf-87f5-dda8c9154a88 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:18.978689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c5753987-dc58-49bf-87f5-dda8c9154a88 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:18.985187 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c5753987-dc58-49bf-87f5-dda8c9154a88 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:18.985625 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c5753987-dc58-49bf-87f5-dda8c9154a88 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:18.986380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c5753987-dc58-49bf-87f5-dda8c9154a88 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:18.986809 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c5753987-dc58-49bf-87f5-dda8c9154a88 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:19.119898 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c5753987-dc58-49bf-87f5-dda8c9154a88 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:19.128086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c5753987-dc58-49bf-87f5-dda8c9154a88 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.154529 Jul 27 07:52:19.128668 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 201/394] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:18 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:19.749996 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a3711b9b-3108-4a5f-8a8e-9b023a8cf6d5 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:19.750653 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a3711b9b-3108-4a5f-8a8e-9b023a8cf6d5 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:19.756753 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a3711b9b-3108-4a5f-8a8e-9b023a8cf6d5 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:19.757202 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a3711b9b-3108-4a5f-8a8e-9b023a8cf6d5 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:19.758600 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a3711b9b-3108-4a5f-8a8e-9b023a8cf6d5 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:19.759068 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a3711b9b-3108-4a5f-8a8e-9b023a8cf6d5 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:19.894668 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a3711b9b-3108-4a5f-8a8e-9b023a8cf6d5 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:19.902141 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a3711b9b-3108-4a5f-8a8e-9b023a8cf6d5 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.156050 Jul 27 07:52:19.902701 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 194/395] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:19 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:20.149491 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-30844ad7-337c-48a6-8b7b-af9d9a862d13 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:20.150007 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-30844ad7-337c-48a6-8b7b-af9d9a862d13 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:20.156635 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30844ad7-337c-48a6-8b7b-af9d9a862d13 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:20.157155 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30844ad7-337c-48a6-8b7b-af9d9a862d13 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:20.157910 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30844ad7-337c-48a6-8b7b-af9d9a862d13 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:20.158350 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30844ad7-337c-48a6-8b7b-af9d9a862d13 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:20.295765 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-30844ad7-337c-48a6-8b7b-af9d9a862d13 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:20.303218 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-30844ad7-337c-48a6-8b7b-af9d9a862d13 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.157632 Jul 27 07:52:20.303778 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 202/396] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:20 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:20.923159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-3e1a1546-a4f6-4c7f-852b-f0c835031513 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:20.923793 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-3e1a1546-a4f6-4c7f-852b-f0c835031513 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:20.930345 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3e1a1546-a4f6-4c7f-852b-f0c835031513 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:20.930786 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3e1a1546-a4f6-4c7f-852b-f0c835031513 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:20.931572 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3e1a1546-a4f6-4c7f-852b-f0c835031513 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:20.931992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3e1a1546-a4f6-4c7f-852b-f0c835031513 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:21.062557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3e1a1546-a4f6-4c7f-852b-f0c835031513 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:21.070067 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-3e1a1546-a4f6-4c7f-852b-f0c835031513 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.150711 Jul 27 07:52:21.070630 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 195/397] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:20 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:21.324469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0e813841-25f0-44ee-86f1-f596473a79fa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:21.325086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0e813841-25f0-44ee-86f1-f596473a79fa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:21.331639 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0e813841-25f0-44ee-86f1-f596473a79fa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:21.332091 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0e813841-25f0-44ee-86f1-f596473a79fa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:21.332862 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0e813841-25f0-44ee-86f1-f596473a79fa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:21.333293 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0e813841-25f0-44ee-86f1-f596473a79fa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:21.464093 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0e813841-25f0-44ee-86f1-f596473a79fa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:21.471548 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0e813841-25f0-44ee-86f1-f596473a79fa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.151082 Jul 27 07:52:21.472164 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 203/398] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:21 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:22.091351 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2d146285-f4c0-4580-9235-c8747f51abce tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:22.091967 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2d146285-f4c0-4580-9235-c8747f51abce tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:22.098464 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2d146285-f4c0-4580-9235-c8747f51abce tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:22.099007 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2d146285-f4c0-4580-9235-c8747f51abce tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:22.100351 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2d146285-f4c0-4580-9235-c8747f51abce tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:22.100794 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2d146285-f4c0-4580-9235-c8747f51abce tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:22.292756 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2d146285-f4c0-4580-9235-c8747f51abce tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:22.300299 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2d146285-f4c0-4580-9235-c8747f51abce tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.213043 Jul 27 07:52:22.300875 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 196/399] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:22 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:22.416772 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-a8b70ef1-148d-4b88-88fa-cbe888285301 req-30810534-c098-45e0-9c83-6000a235ec4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe285eb7-17fb-48f0-b380-f21aeeb82332", "tag": "a6810efb-5496-44f0-a63c-6868e0e1ac93"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:52:22.441576 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-a8b70ef1-148d-4b88-88fa-cbe888285301 req-30810534-c098-45e0-9c83-6000a235ec4c service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:22.442023 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-a8b70ef1-148d-4b88-88fa-cbe888285301 req-30810534-c098-45e0-9c83-6000a235ec4c service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:22.454438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-a8b70ef1-148d-4b88-88fa-cbe888285301 req-30810534-c098-45e0-9c83-6000a235ec4c service nova] Creating event network-changed:a6810efb-5496-44f0-a63c-6868e0e1ac93 for instance fe285eb7-17fb-48f0-b380-f21aeeb82332 on hv-cinder-82549 Jul 27 07:52:22.459496 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-a8b70ef1-148d-4b88-88fa-cbe888285301 req-30810534-c098-45e0-9c83-6000a235ec4c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053389 Jul 27 07:52:22.460099 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 204/400] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:52:22.494852 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b35572cb-87e9-49ba-8b03-a59efc3c79b6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:22.495508 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b35572cb-87e9-49ba-8b03-a59efc3c79b6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:22.502466 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b35572cb-87e9-49ba-8b03-a59efc3c79b6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:22.502939 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b35572cb-87e9-49ba-8b03-a59efc3c79b6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:22.503724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b35572cb-87e9-49ba-8b03-a59efc3c79b6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:22.504162 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b35572cb-87e9-49ba-8b03-a59efc3c79b6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:22.653591 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b35572cb-87e9-49ba-8b03-a59efc3c79b6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:22.661015 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b35572cb-87e9-49ba-8b03-a59efc3c79b6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.170942 Jul 27 07:52:22.661703 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 197/401] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:22 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:23.322454 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-cfae1943-1b9f-4c78-9a34-0e75de700edd tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:23.323169 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-cfae1943-1b9f-4c78-9a34-0e75de700edd tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:23.329648 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cfae1943-1b9f-4c78-9a34-0e75de700edd tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:23.330102 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cfae1943-1b9f-4c78-9a34-0e75de700edd tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:23.330860 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cfae1943-1b9f-4c78-9a34-0e75de700edd tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:23.331323 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cfae1943-1b9f-4c78-9a34-0e75de700edd tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:23.479139 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-cfae1943-1b9f-4c78-9a34-0e75de700edd tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:23.489995 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-cfae1943-1b9f-4c78-9a34-0e75de700edd tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.172186 Jul 27 07:52:23.490614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 205/402] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:23 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:23.683112 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ae35910f-c738-4fdd-bac9-14047cc3e616 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:23.683727 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ae35910f-c738-4fdd-bac9-14047cc3e616 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:23.685576 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:23.690864 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ae35910f-c738-4fdd-bac9-14047cc3e616 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:23.691343 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ae35910f-c738-4fdd-bac9-14047cc3e616 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:23.692156 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ae35910f-c738-4fdd-bac9-14047cc3e616 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:23.692582 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ae35910f-c738-4fdd-bac9-14047cc3e616 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:23.829641 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ae35910f-c738-4fdd-bac9-14047cc3e616 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:23.837291 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ae35910f-c738-4fdd-bac9-14047cc3e616 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.158673 Jul 27 07:52:23.837854 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 198/403] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:23 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:24.512422 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0120d59c-b5cf-46db-a2b8-b809cf878e84 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:24.513036 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0120d59c-b5cf-46db-a2b8-b809cf878e84 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:24.519604 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0120d59c-b5cf-46db-a2b8-b809cf878e84 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:24.520045 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0120d59c-b5cf-46db-a2b8-b809cf878e84 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:24.520807 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0120d59c-b5cf-46db-a2b8-b809cf878e84 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:24.521248 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0120d59c-b5cf-46db-a2b8-b809cf878e84 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:24.663913 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0120d59c-b5cf-46db-a2b8-b809cf878e84 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:24.671428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0120d59c-b5cf-46db-a2b8-b809cf878e84 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.162837 Jul 27 07:52:24.671991 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 206/404] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:24 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:24.863269 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1abbd5f6-44cf-4f6d-b91d-96ed7c3ecbce tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:24.863883 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1abbd5f6-44cf-4f6d-b91d-96ed7c3ecbce tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:24.869961 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1abbd5f6-44cf-4f6d-b91d-96ed7c3ecbce tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:24.870409 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1abbd5f6-44cf-4f6d-b91d-96ed7c3ecbce tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:24.871228 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1abbd5f6-44cf-4f6d-b91d-96ed7c3ecbce tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:24.871669 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1abbd5f6-44cf-4f6d-b91d-96ed7c3ecbce tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:25.000619 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1abbd5f6-44cf-4f6d-b91d-96ed7c3ecbce tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:25.002791 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=100 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:25.009954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1abbd5f6-44cf-4f6d-b91d-96ed7c3ecbce tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.150034 Jul 27 07:52:25.010519 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 199/405] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:24 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:25.691609 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a83a807c-1a9f-4c00-87cc-f40c1b8e626d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:25.692225 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a83a807c-1a9f-4c00-87cc-f40c1b8e626d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:25.699461 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a83a807c-1a9f-4c00-87cc-f40c1b8e626d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:25.700022 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a83a807c-1a9f-4c00-87cc-f40c1b8e626d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:25.700877 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a83a807c-1a9f-4c00-87cc-f40c1b8e626d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:25.701321 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a83a807c-1a9f-4c00-87cc-f40c1b8e626d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:25.833226 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a83a807c-1a9f-4c00-87cc-f40c1b8e626d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:25.841394 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a83a807c-1a9f-4c00-87cc-f40c1b8e626d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.153650 Jul 27 07:52:25.841962 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 207/406] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:25 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:26.030930 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7b1cc01f-7c70-410b-9ce3-c6b11f8989da tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:26.031545 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-7b1cc01f-7c70-410b-9ce3-c6b11f8989da tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:26.037472 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7b1cc01f-7c70-410b-9ce3-c6b11f8989da tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:26.037910 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7b1cc01f-7c70-410b-9ce3-c6b11f8989da tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:26.038665 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7b1cc01f-7c70-410b-9ce3-c6b11f8989da tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:26.039120 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7b1cc01f-7c70-410b-9ce3-c6b11f8989da tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:26.180852 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7b1cc01f-7c70-410b-9ce3-c6b11f8989da tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:26.192000 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7b1cc01f-7c70-410b-9ce3-c6b11f8989da tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.164763 Jul 27 07:52:26.192585 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 200/407] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:26 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:26.864310 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6417bcab-4f75-4d14-9834-f02a4283ddf7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:26.864929 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6417bcab-4f75-4d14-9834-f02a4283ddf7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:26.872280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6417bcab-4f75-4d14-9834-f02a4283ddf7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:26.872736 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6417bcab-4f75-4d14-9834-f02a4283ddf7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:26.873592 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6417bcab-4f75-4d14-9834-f02a4283ddf7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:26.874033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6417bcab-4f75-4d14-9834-f02a4283ddf7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:27.016471 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6417bcab-4f75-4d14-9834-f02a4283ddf7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:27.025390 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6417bcab-4f75-4d14-9834-f02a4283ddf7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.164930 Jul 27 07:52:27.026023 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 208/408] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:26 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:27.216520 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-aa6dab4f-7740-4823-b688-805f73a47f06 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:27.217138 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-aa6dab4f-7740-4823-b688-805f73a47f06 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:27.223268 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aa6dab4f-7740-4823-b688-805f73a47f06 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:27.223977 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aa6dab4f-7740-4823-b688-805f73a47f06 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:27.224774 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aa6dab4f-7740-4823-b688-805f73a47f06 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:27.225265 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aa6dab4f-7740-4823-b688-805f73a47f06 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:27.358535 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-aa6dab4f-7740-4823-b688-805f73a47f06 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:27.366068 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-aa6dab4f-7740-4823-b688-805f73a47f06 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.153958 Jul 27 07:52:27.366633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 201/409] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:27 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:52:28.046248 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9dd37b17-440d-4c09-bb9c-576c64eedc00 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:28.046949 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9dd37b17-440d-4c09-bb9c-576c64eedc00 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:28.053470 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9dd37b17-440d-4c09-bb9c-576c64eedc00 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:28.053921 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9dd37b17-440d-4c09-bb9c-576c64eedc00 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:28.054690 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9dd37b17-440d-4c09-bb9c-576c64eedc00 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:28.055156 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9dd37b17-440d-4c09-bb9c-576c64eedc00 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:28.185692 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9dd37b17-440d-4c09-bb9c-576c64eedc00 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:28.193145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9dd37b17-440d-4c09-bb9c-576c64eedc00 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.150785 Jul 27 07:52:28.193716 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 209/410] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:28 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:28.388059 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2d97fb69-785e-4842-8f9e-aafc2e186432 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:28.388667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2d97fb69-785e-4842-8f9e-aafc2e186432 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:28.394670 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2d97fb69-785e-4842-8f9e-aafc2e186432 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:28.395158 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2d97fb69-785e-4842-8f9e-aafc2e186432 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:28.395921 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2d97fb69-785e-4842-8f9e-aafc2e186432 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:28.396370 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2d97fb69-785e-4842-8f9e-aafc2e186432 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:28.524158 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2d97fb69-785e-4842-8f9e-aafc2e186432 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:28.532277 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2d97fb69-785e-4842-8f9e-aafc2e186432 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.148618 Jul 27 07:52:28.532848 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 202/411] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:28 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:29.216893 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b6e32738-10f6-4d80-907f-a06568cad3f0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:29.217503 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b6e32738-10f6-4d80-907f-a06568cad3f0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:29.219925 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=52 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:29.226039 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b6e32738-10f6-4d80-907f-a06568cad3f0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:29.226485 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b6e32738-10f6-4d80-907f-a06568cad3f0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:29.227282 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b6e32738-10f6-4d80-907f-a06568cad3f0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:29.227716 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b6e32738-10f6-4d80-907f-a06568cad3f0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:29.368503 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b6e32738-10f6-4d80-907f-a06568cad3f0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:29.376601 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b6e32738-10f6-4d80-907f-a06568cad3f0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.163571 Jul 27 07:52:29.377081 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 210/412] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:29 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:29.553392 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-bd25a435-1381-4ad4-8f87-beb72278fc72 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:29.554003 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-bd25a435-1381-4ad4-8f87-beb72278fc72 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:29.560337 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bd25a435-1381-4ad4-8f87-beb72278fc72 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:29.560790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bd25a435-1381-4ad4-8f87-beb72278fc72 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:29.561554 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bd25a435-1381-4ad4-8f87-beb72278fc72 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:29.561994 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bd25a435-1381-4ad4-8f87-beb72278fc72 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:29.698104 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-bd25a435-1381-4ad4-8f87-beb72278fc72 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:29.706098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-bd25a435-1381-4ad4-8f87-beb72278fc72 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.156595 Jul 27 07:52:29.706666 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 203/413] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:29 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:30.397194 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-90f121c8-71d2-4d40-86ab-b0678dbb0ce8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:30.397807 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-90f121c8-71d2-4d40-86ab-b0678dbb0ce8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:30.404343 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-90f121c8-71d2-4d40-86ab-b0678dbb0ce8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:30.404791 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-90f121c8-71d2-4d40-86ab-b0678dbb0ce8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:30.405554 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-90f121c8-71d2-4d40-86ab-b0678dbb0ce8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:30.405988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-90f121c8-71d2-4d40-86ab-b0678dbb0ce8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:30.539295 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-90f121c8-71d2-4d40-86ab-b0678dbb0ce8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:30.551465 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-90f121c8-71d2-4d40-86ab-b0678dbb0ce8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.158050 Jul 27 07:52:30.552054 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 211/414] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:30 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:30.730132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-51caaec8-5a50-48df-b97d-4c3e054b81cf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:30.730746 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-51caaec8-5a50-48df-b97d-4c3e054b81cf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:30.736875 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-51caaec8-5a50-48df-b97d-4c3e054b81cf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:30.737322 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-51caaec8-5a50-48df-b97d-4c3e054b81cf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:30.738712 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-51caaec8-5a50-48df-b97d-4c3e054b81cf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:30.739177 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-51caaec8-5a50-48df-b97d-4c3e054b81cf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:30.877114 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-51caaec8-5a50-48df-b97d-4c3e054b81cf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:30.886303 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-51caaec8-5a50-48df-b97d-4c3e054b81cf tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.160399 Jul 27 07:52:30.886936 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 204/415] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:30 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:31.571990 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-acb8b4c9-d60a-41bf-a2cb-23ec8f0d3cb0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:31.573094 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-acb8b4c9-d60a-41bf-a2cb-23ec8f0d3cb0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:31.579602 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-acb8b4c9-d60a-41bf-a2cb-23ec8f0d3cb0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:31.580049 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-acb8b4c9-d60a-41bf-a2cb-23ec8f0d3cb0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:31.580812 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-acb8b4c9-d60a-41bf-a2cb-23ec8f0d3cb0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:31.581251 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-acb8b4c9-d60a-41bf-a2cb-23ec8f0d3cb0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:31.709445 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-acb8b4c9-d60a-41bf-a2cb-23ec8f0d3cb0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:31.718640 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-acb8b4c9-d60a-41bf-a2cb-23ec8f0d3cb0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.150245 Jul 27 07:52:31.725463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 212/416] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:31 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:31.907407 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-8df548bb-aab8-4ddf-b139-04204e2388b9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:31.908019 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-8df548bb-aab8-4ddf-b139-04204e2388b9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:31.914115 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8df548bb-aab8-4ddf-b139-04204e2388b9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:31.914560 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8df548bb-aab8-4ddf-b139-04204e2388b9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:31.915351 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8df548bb-aab8-4ddf-b139-04204e2388b9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:31.915792 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8df548bb-aab8-4ddf-b139-04204e2388b9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:32.046435 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8df548bb-aab8-4ddf-b139-04204e2388b9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:32.053980 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-8df548bb-aab8-4ddf-b139-04204e2388b9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.150468 Jul 27 07:52:32.054539 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 205/417] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:31 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:32.741018 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c80a4b4d-4362-4333-906c-39066bf7a2ef tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:32.741633 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c80a4b4d-4362-4333-906c-39066bf7a2ef tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:32.749721 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c80a4b4d-4362-4333-906c-39066bf7a2ef tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:32.750172 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c80a4b4d-4362-4333-906c-39066bf7a2ef tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:32.750969 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c80a4b4d-4362-4333-906c-39066bf7a2ef tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:32.751413 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c80a4b4d-4362-4333-906c-39066bf7a2ef tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:32.887713 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c80a4b4d-4362-4333-906c-39066bf7a2ef tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:32.895118 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c80a4b4d-4362-4333-906c-39066bf7a2ef tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.157880 Jul 27 07:52:32.895943 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 213/418] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:32 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:33.074823 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f646ae84-574d-4dad-95a3-809f735243ff tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:33.075460 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f646ae84-574d-4dad-95a3-809f735243ff tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:33.081521 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f646ae84-574d-4dad-95a3-809f735243ff tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:33.081908 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f646ae84-574d-4dad-95a3-809f735243ff tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:33.082663 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f646ae84-574d-4dad-95a3-809f735243ff tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:33.083135 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f646ae84-574d-4dad-95a3-809f735243ff tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:33.211371 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f646ae84-574d-4dad-95a3-809f735243ff tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:33.219310 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f646ae84-574d-4dad-95a3-809f735243ff tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.148291 Jul 27 07:52:33.219872 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 206/419] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:33 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:33.917490 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-07014540-8ec4-4473-a3df-7271f3d2d052 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:33.918019 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-07014540-8ec4-4473-a3df-7271f3d2d052 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:33.924521 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-07014540-8ec4-4473-a3df-7271f3d2d052 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:33.924974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-07014540-8ec4-4473-a3df-7271f3d2d052 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:33.925740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-07014540-8ec4-4473-a3df-7271f3d2d052 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:33.926179 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-07014540-8ec4-4473-a3df-7271f3d2d052 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:34.059857 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-07014540-8ec4-4473-a3df-7271f3d2d052 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:34.067522 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-07014540-8ec4-4473-a3df-7271f3d2d052 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.154116 Jul 27 07:52:34.068099 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 214/420] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:33 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:34.242038 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a71e354b-8d20-4eb8-9dc4-382c97049837 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:34.242559 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a71e354b-8d20-4eb8-9dc4-382c97049837 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:34.249550 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a71e354b-8d20-4eb8-9dc4-382c97049837 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:34.250010 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a71e354b-8d20-4eb8-9dc4-382c97049837 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:34.250759 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a71e354b-8d20-4eb8-9dc4-382c97049837 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:34.251230 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a71e354b-8d20-4eb8-9dc4-382c97049837 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:34.392540 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a71e354b-8d20-4eb8-9dc4-382c97049837 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:34.402487 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a71e354b-8d20-4eb8-9dc4-382c97049837 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.164273 Jul 27 07:52:34.403101 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 207/421] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:34 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:35.089276 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a4c0b6b8-95b5-4949-95d6-3bbe876d8215 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:35.090070 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a4c0b6b8-95b5-4949-95d6-3bbe876d8215 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:35.100163 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a4c0b6b8-95b5-4949-95d6-3bbe876d8215 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:35.100689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a4c0b6b8-95b5-4949-95d6-3bbe876d8215 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:35.101651 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a4c0b6b8-95b5-4949-95d6-3bbe876d8215 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:35.102097 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a4c0b6b8-95b5-4949-95d6-3bbe876d8215 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:35.235190 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a4c0b6b8-95b5-4949-95d6-3bbe876d8215 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:35.242621 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a4c0b6b8-95b5-4949-95d6-3bbe876d8215 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.158196 Jul 27 07:52:35.243215 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 215/422] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:35 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:35.426672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7a2554b6-8227-417b-8eac-4d9a61c160ed tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:35.428062 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-7a2554b6-8227-417b-8eac-4d9a61c160ed tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:35.459972 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7a2554b6-8227-417b-8eac-4d9a61c160ed tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:35.460431 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7a2554b6-8227-417b-8eac-4d9a61c160ed tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:35.461225 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7a2554b6-8227-417b-8eac-4d9a61c160ed tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:35.461666 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7a2554b6-8227-417b-8eac-4d9a61c160ed tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:35.595487 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7a2554b6-8227-417b-8eac-4d9a61c160ed tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:35.603096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7a2554b6-8227-417b-8eac-4d9a61c160ed tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.181698 Jul 27 07:52:35.604279 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 208/423] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:35 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:36.267104 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0497e0f0-80d1-453c-84dd-34b690618864 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:36.267906 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0497e0f0-80d1-453c-84dd-34b690618864 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:36.274086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0497e0f0-80d1-453c-84dd-34b690618864 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:36.274531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0497e0f0-80d1-453c-84dd-34b690618864 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:36.275322 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0497e0f0-80d1-453c-84dd-34b690618864 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:36.275752 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0497e0f0-80d1-453c-84dd-34b690618864 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:36.280859 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:36.497417 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0497e0f0-80d1-453c-84dd-34b690618864 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:36.508706 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0497e0f0-80d1-453c-84dd-34b690618864 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.246200 Jul 27 07:52:36.512833 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 216/424] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:36 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:36.624409 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a61ec347-109d-44df-9fc6-1fbc95d9cdef tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:36.625025 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a61ec347-109d-44df-9fc6-1fbc95d9cdef tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:36.632187 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a61ec347-109d-44df-9fc6-1fbc95d9cdef tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:36.632631 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a61ec347-109d-44df-9fc6-1fbc95d9cdef tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:36.633405 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a61ec347-109d-44df-9fc6-1fbc95d9cdef tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:36.633837 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a61ec347-109d-44df-9fc6-1fbc95d9cdef tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:36.775557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a61ec347-109d-44df-9fc6-1fbc95d9cdef tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:36.783619 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a61ec347-109d-44df-9fc6-1fbc95d9cdef tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.162721 Jul 27 07:52:36.784194 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 209/425] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:36 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:37.035499 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-0f89efc6-3d18-479a-9d96-15d02456503e req-68a10414-4700-46b6-abd8-8688e4574274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe285eb7-17fb-48f0-b380-f21aeeb82332", "name": "network-vif-plugged", "status": "completed", "tag": "a6810efb-5496-44f0-a63c-6868e0e1ac93"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:52:37.057727 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-0f89efc6-3d18-479a-9d96-15d02456503e req-68a10414-4700-46b6-abd8-8688e4574274 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:37.058706 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-0f89efc6-3d18-479a-9d96-15d02456503e req-68a10414-4700-46b6-abd8-8688e4574274 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:37.071779 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-0f89efc6-3d18-479a-9d96-15d02456503e req-68a10414-4700-46b6-abd8-8688e4574274 service nova] Creating event network-vif-plugged:a6810efb-5496-44f0-a63c-6868e0e1ac93 for instance fe285eb7-17fb-48f0-b380-f21aeeb82332 on hv-cinder-82549 Jul 27 07:52:37.077463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-0f89efc6-3d18-479a-9d96-15d02456503e req-68a10414-4700-46b6-abd8-8688e4574274 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047139 Jul 27 07:52:37.077965 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 217/426] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:52:37.531183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-5095f9f2-fdca-46b4-bce6-9db69da74f35 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:37.532298 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-5095f9f2-fdca-46b4-bce6-9db69da74f35 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:37.545263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5095f9f2-fdca-46b4-bce6-9db69da74f35 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:37.545847 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5095f9f2-fdca-46b4-bce6-9db69da74f35 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:37.546730 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5095f9f2-fdca-46b4-bce6-9db69da74f35 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:37.547533 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5095f9f2-fdca-46b4-bce6-9db69da74f35 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:37.771927 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-5095f9f2-fdca-46b4-bce6-9db69da74f35 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:37.780298 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-5095f9f2-fdca-46b4-bce6-9db69da74f35 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.253842 Jul 27 07:52:37.803331 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 210/427] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:37 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:37.805962 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-db7c9ccc-17e2-460d-91b2-d9a1e0b68644 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:37.807255 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-db7c9ccc-17e2-460d-91b2-d9a1e0b68644 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:37.814247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-db7c9ccc-17e2-460d-91b2-d9a1e0b68644 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:37.814788 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-db7c9ccc-17e2-460d-91b2-d9a1e0b68644 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:37.815690 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-db7c9ccc-17e2-460d-91b2-d9a1e0b68644 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:37.816629 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-db7c9ccc-17e2-460d-91b2-d9a1e0b68644 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:38.033243 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-db7c9ccc-17e2-460d-91b2-d9a1e0b68644 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:38.040914 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-db7c9ccc-17e2-460d-91b2-d9a1e0b68644 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1502 microversion: 2.1 time: 0.239266 Jul 27 07:52:38.042489 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 218/428] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:37 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1502 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:38.062137 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c192a9bf-9697-433d-844c-3d60a7bc57e7 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae010cd8-dfec-473c-a556-ddb22d6ca49e"}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:52:38.064917 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c192a9bf-9697-433d-844c-3d60a7bc57e7 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:38.071394 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c192a9bf-9697-433d-844c-3d60a7bc57e7 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:38.071844 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c192a9bf-9697-433d-844c-3d60a7bc57e7 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:38.073156 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c192a9bf-9697-433d-844c-3d60a7bc57e7 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:38.073853 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c192a9bf-9697-433d-844c-3d60a7bc57e7 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-c192a9bf-9697-433d-844c-3d60a7bc57e7 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] HTTP exception thrown: Cannot 'attach_volume' instance 0d14cae7-2ec9-4ab1-94c5-b63982ffc251 while it is in vm_state rescued Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c192a9bf-9697-433d-844c-3d60a7bc57e7 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Request method failure captured: Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: POST /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251/os-volume_attachments HTTP/1.1 Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 74 Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O4UORz8wXhJ1kpiVNKXyE9VfzhMjRPMohCBHR61uSEgltK23AovTklhZktQwS1YkSIKv0p3xV2eZ4RBk4xLQVS9IMyH6g9DNMRWw9sV4BpxkaTRoJnwP5qMK153QRb-rvTyPfZE1GV6jzU-bzssuyWDHqvLNYZVXDmSYB5S7JuTYMo Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: c8e43fa41dc8445abed15accf9163b32 Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2087922844 Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 07:52:38.106976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 07:52:38.108912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:52:38.108912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2087922844 Jul 27 07:52:38.108912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: c8e43fa41dc8445abed15accf9163b32 Jul 27 07:52:38.108912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2087922844 Jul 27 07:52:38.108912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-ServerRescueNegativeTestJSON-2087922844-project Jul 27 07:52:38.108912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 07:52:38.108912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 07:52:38.108912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: cb1cee30bc59446d882880d978b78bc2 Jul 27 07:52:38.108912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2087922844-project Jul 27 07:52:38.108912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Jul 27 07:52:38.108912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {"volumeAttachment": {"volumeId": "ae010cd8-dfec-473c-a556-ddb22d6ca49e"}} Jul 27 07:52:38.108912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 07:52:38.109821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Cannot 'attach_volume' instance 0d14cae7-2ec9-4ab1-94c5-b63982ffc251 while it is in vm_state rescued Jul 27 07:52:38.109821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'server_id': '0d14cae7-2ec9-4ab1-94c5-b63982ffc251', 'body': {'volumeAttachment': {'volumeId': 'ae010cd8-dfec-473c-a556-ddb22d6ca49e'}}} Jul 27 07:52:38.109821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:52:38.109821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:52:38.109821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 07:52:38.109821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 07:52:38.109821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 27 07:52:38.109821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 07:52:38.109821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 27 07:52:38.109821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 27 07:52:38.109821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0d14cae7-2ec9-4ab1-94c5-b63982ffc251 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 27 07:52:38.109821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:52:38.109821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:52:38.109821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:52:38.109821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:52:38.109821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:52:38.109821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:52:38.109821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:52:38.109821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:52:38.111991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:52:38.111991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:52:38.111991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 07:52:38.111991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 07:52:38.111991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 07:52:38.111991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 07:52:38.111991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 07:52:38.111991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 07:52:38.111991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 27 07:52:38.111991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 27 07:52:38.111991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 27 07:52:38.111991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 27 07:52:38.111991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0d14cae7-2ec9-4ab1-94c5-b63982ffc251 while it is in vm_state rescued Jul 27 07:52:38.111991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:52:38.111991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:52:38.111991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:52:38.111991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:52:38.111991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:52:38.111991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:52:38.113369 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:52:38.113369 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:52:38.113369 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0d14cae7-2ec9-4ab1-94c5-b63982ffc251 while it is in vm_state rescued Jul 27 07:52:38.113369 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:52:38.113369 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c192a9bf-9697-433d-844c-3d60a7bc57e7 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Returning 409 to user: Cannot 'attach_volume' instance 0d14cae7-2ec9-4ab1-94c5-b63982ffc251 while it is in vm_state rescued {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:52:38.113369 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c192a9bf-9697-433d-844c-3d60a7bc57e7 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "POST /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051377 Jul 27 07:52:38.113369 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 211/429] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Jul 27 07:52:38 2022] POST /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 27 07:52:38.120076 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e6563b22-3275-4177-94c6-b9c513ac2f83 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:52:38.120634 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e6563b22-3275-4177-94c6-b9c513ac2f83 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:38.127521 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e6563b22-3275-4177-94c6-b9c513ac2f83 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:38.127965 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e6563b22-3275-4177-94c6-b9c513ac2f83 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:38.128726 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e6563b22-3275-4177-94c6-b9c513ac2f83 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:38.129154 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e6563b22-3275-4177-94c6-b9c513ac2f83 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:38.200207 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e6563b22-3275-4177-94c6-b9c513ac2f83 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "POST /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251/action" status: 202 len: 0 microversion: 2.1 time: 0.084475 Jul 27 07:52:38.201463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 219/430] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Jul 27 07:52:38 2022] POST /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 07:52:38.209192 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1208c0a4-29d2-47cf-8a8f-e634c4650524 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:38.209886 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1208c0a4-29d2-47cf-8a8f-e634c4650524 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:38.217985 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1208c0a4-29d2-47cf-8a8f-e634c4650524 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:38.218492 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1208c0a4-29d2-47cf-8a8f-e634c4650524 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:38.223331 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1208c0a4-29d2-47cf-8a8f-e634c4650524 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:38.224030 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1208c0a4-29d2-47cf-8a8f-e634c4650524 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:38.368612 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1208c0a4-29d2-47cf-8a8f-e634c4650524 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:38.377595 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1208c0a4-29d2-47cf-8a8f-e634c4650524 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1510 microversion: 2.1 time: 0.172256 Jul 27 07:52:38.378866 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 212/431] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:38 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:38.805865 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2875cc99-786d-49dd-abeb-f81ba7091eaf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:38.806972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2875cc99-786d-49dd-abeb-f81ba7091eaf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:38.814978 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2875cc99-786d-49dd-abeb-f81ba7091eaf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:38.815425 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2875cc99-786d-49dd-abeb-f81ba7091eaf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:38.816404 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2875cc99-786d-49dd-abeb-f81ba7091eaf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:38.816834 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2875cc99-786d-49dd-abeb-f81ba7091eaf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:39.020823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2875cc99-786d-49dd-abeb-f81ba7091eaf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:39.033938 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2875cc99-786d-49dd-abeb-f81ba7091eaf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1358 microversion: 2.1 time: 0.232965 Jul 27 07:52:39.034513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 220/432] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:38 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:52:39.399515 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9d1aa235-ea83-4245-b623-abf457ce5f04 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:39.400870 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-9d1aa235-ea83-4245-b623-abf457ce5f04 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:39.412459 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9d1aa235-ea83-4245-b623-abf457ce5f04 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:39.415085 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9d1aa235-ea83-4245-b623-abf457ce5f04 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:39.416873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9d1aa235-ea83-4245-b623-abf457ce5f04 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:39.419149 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9d1aa235-ea83-4245-b623-abf457ce5f04 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:39.930599 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9d1aa235-ea83-4245-b623-abf457ce5f04 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:39.940188 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9d1aa235-ea83-4245-b623-abf457ce5f04 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1510 microversion: 2.1 time: 0.542985 Jul 27 07:52:39.941126 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 213/433] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:39 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1510 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:40.054989 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c3a40d5b-39b9-4854-b890-0716b8e83b53 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:40.055812 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c3a40d5b-39b9-4854-b890-0716b8e83b53 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:40.063716 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c3a40d5b-39b9-4854-b890-0716b8e83b53 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:40.064492 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c3a40d5b-39b9-4854-b890-0716b8e83b53 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:40.065375 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c3a40d5b-39b9-4854-b890-0716b8e83b53 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:40.065914 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c3a40d5b-39b9-4854-b890-0716b8e83b53 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:40.278518 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c3a40d5b-39b9-4854-b890-0716b8e83b53 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:40.290502 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c3a40d5b-39b9-4854-b890-0716b8e83b53 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1547 microversion: 2.1 time: 0.239051 Jul 27 07:52:40.303885 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 221/434] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:40 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1547 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:52:40.316973 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-197490a9-3900-46bd-81c6-010aa5817b5b tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:40.317645 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-197490a9-3900-46bd-81c6-010aa5817b5b tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:40.325148 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-197490a9-3900-46bd-81c6-010aa5817b5b tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:40.326021 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-197490a9-3900-46bd-81c6-010aa5817b5b tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:40.327102 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-197490a9-3900-46bd-81c6-010aa5817b5b tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:40.327948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-197490a9-3900-46bd-81c6-010aa5817b5b tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:40.631512 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-197490a9-3900-46bd-81c6-010aa5817b5b tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:40.645236 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-197490a9-3900-46bd-81c6-010aa5817b5b tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1547 microversion: 2.1 time: 0.334633 Jul 27 07:52:40.647047 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 214/435] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:40 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1547 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:40.666352 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8304a171-5184-4c04-808b-29f2785bf49c tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:40.671566 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8304a171-5184-4c04-808b-29f2785bf49c tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:40.672589 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8304a171-5184-4c04-808b-29f2785bf49c tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Searching by: {'deleted': False, 'project_id': '4271996d22bc4364a5554c0fbff0378b'} {{(pid=117780) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 27 07:52:40.679776 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8304a171-5184-4c04-808b-29f2785bf49c tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:40.680231 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8304a171-5184-4c04-808b-29f2785bf49c tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:40.681953 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8304a171-5184-4c04-808b-29f2785bf49c tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:40.681953 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8304a171-5184-4c04-808b-29f2785bf49c tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:40.772654 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.multi_cell_list [None req-8304a171-5184-4c04-808b-29f2785bf49c tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117780) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 27 07:52:40.877469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8304a171-5184-4c04-808b-29f2785bf49c tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.214923 Jul 27 07:52:40.877979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 222/436] 10.222.0.18 () {58 vars in 1125 bytes} [Wed Jul 27 07:52:40 2022] GET /compute/v2.1/servers => generated 342 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:52:40.889944 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a7d0fc43-9196-4bae-880f-87cb244b7151 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:40.890654 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a7d0fc43-9196-4bae-880f-87cb244b7151 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:40.897189 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a7d0fc43-9196-4bae-880f-87cb244b7151 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:40.897631 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a7d0fc43-9196-4bae-880f-87cb244b7151 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:40.898867 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a7d0fc43-9196-4bae-880f-87cb244b7151 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:40.898867 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a7d0fc43-9196-4bae-880f-87cb244b7151 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:40.962435 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5083cf32-b8a7-4984-8515-8b6c62852881 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:40.963113 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5083cf32-b8a7-4984-8515-8b6c62852881 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:40.970792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5083cf32-b8a7-4984-8515-8b6c62852881 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:40.971321 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5083cf32-b8a7-4984-8515-8b6c62852881 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:40.972289 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5083cf32-b8a7-4984-8515-8b6c62852881 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:40.972731 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5083cf32-b8a7-4984-8515-8b6c62852881 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:41.132319 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5083cf32-b8a7-4984-8515-8b6c62852881 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:41.141542 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5083cf32-b8a7-4984-8515-8b6c62852881 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1510 microversion: 2.1 time: 0.183923 Jul 27 07:52:41.143051 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 223/437] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:40 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:52:41.204598 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a7d0fc43-9196-4bae-880f-87cb244b7151 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:41.218051 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a7d0fc43-9196-4bae-880f-87cb244b7151 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1547 microversion: 2.1 time: 0.331783 Jul 27 07:52:41.218980 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 215/438] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:40 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1547 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:42.164074 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f0a64cd8-9ef0-4052-a28b-0f031b4d4388 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:42.164694 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f0a64cd8-9ef0-4052-a28b-0f031b4d4388 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:42.179377 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0a64cd8-9ef0-4052-a28b-0f031b4d4388 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:42.180067 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0a64cd8-9ef0-4052-a28b-0f031b4d4388 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:42.180871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0a64cd8-9ef0-4052-a28b-0f031b4d4388 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:42.181939 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0a64cd8-9ef0-4052-a28b-0f031b4d4388 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:42.413191 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f0a64cd8-9ef0-4052-a28b-0f031b4d4388 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:42.423590 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f0a64cd8-9ef0-4052-a28b-0f031b4d4388 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1510 microversion: 2.1 time: 0.263261 Jul 27 07:52:42.440419 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 224/439] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:42 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1510 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:42.969223 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f7bb88b7-94f8-4f18-a795-2bc7a21410b7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd702758-086f-4643-952a-c373feb55a55"}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:52:42.972365 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f7bb88b7-94f8-4f18-a795-2bc7a21410b7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:42.979613 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f7bb88b7-94f8-4f18-a795-2bc7a21410b7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:42.980037 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f7bb88b7-94f8-4f18-a795-2bc7a21410b7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:42.981096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f7bb88b7-94f8-4f18-a795-2bc7a21410b7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:42.981414 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f7bb88b7-94f8-4f18-a795-2bc7a21410b7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:43.056706 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=100 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:43.445495 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c3440ec4-4486-4212-9e06-46b0d9246e68 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:43.447767 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c3440ec4-4486-4212-9e06-46b0d9246e68 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:43.461448 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c3440ec4-4486-4212-9e06-46b0d9246e68 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:43.462012 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c3440ec4-4486-4212-9e06-46b0d9246e68 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:43.464577 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c3440ec4-4486-4212-9e06-46b0d9246e68 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:43.465127 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c3440ec4-4486-4212-9e06-46b0d9246e68 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:43.708738 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c3440ec4-4486-4212-9e06-46b0d9246e68 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:43.725367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c3440ec4-4486-4212-9e06-46b0d9246e68 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1510 microversion: 2.1 time: 0.283944 Jul 27 07:52:43.729092 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 225/440] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:43 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1510 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:44.067303 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f7bb88b7-94f8-4f18-a795-2bc7a21410b7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "POST /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.101300 Jul 27 07:52:44.076587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 216/441] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Jul 27 07:52:42 2022] POST /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332/os-volume_attachments => generated 194 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:52:44.748687 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d58f9bfd-88e5-4431-b296-d334956bc3f9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:44.749306 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d58f9bfd-88e5-4431-b296-d334956bc3f9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:44.766718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d58f9bfd-88e5-4431-b296-d334956bc3f9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:44.769732 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d58f9bfd-88e5-4431-b296-d334956bc3f9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:44.772923 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d58f9bfd-88e5-4431-b296-d334956bc3f9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:44.775661 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d58f9bfd-88e5-4431-b296-d334956bc3f9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:45.075416 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d58f9bfd-88e5-4431-b296-d334956bc3f9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:45.086836 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d58f9bfd-88e5-4431-b296-d334956bc3f9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1516 microversion: 2.1 time: 0.342034 Jul 27 07:52:45.088987 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 226/442] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:44 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1516 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:46.951822 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1118c3e6-01ff-451a-9b6e-2ff8885e4d40 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Action: 'create', calling method: .version_select at 0x7f19fe5cb670>, body: {"keypair": {"name": "tempest-keypair-523682687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABKcjJrjlp54JUHKnXiy7lTporr5qGnttdkycmyrdKyhBLmjtu1fgGb4gX+huEYlC+nPj5lrGyxOCRoKdm0YDpI4Jwk0V+AIcnoevfWAccj1ylXl78JC1M5wWvr3hQQHg=="}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:52:46.980159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-1118c3e6-01ff-451a-9b6e-2ff8885e4d40 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Getting quotas for project c8e43fa41dc8445abed15accf9163b32. Resources: {'key_pairs'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:52:46.985460 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-1118c3e6-01ff-451a-9b6e-2ff8885e4d40 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Getting quotas for user cb1cee30bc59446d882880d978b78bc2 and project c8e43fa41dc8445abed15accf9163b32. Resources: {'key_pairs'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:52:47.014557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1118c3e6-01ff-451a-9b6e-2ff8885e4d40 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.079369 Jul 27 07:52:47.016727 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 217/443] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Jul 27 07:52:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:52:49.688920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1e9294ad-6807-46e4-96a9-9c9b2875a24b tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1423906220", "imageRef": "646bfb5d-ef25-404a-a432-35d4209840fd", "flavorRef": "452", "networks": [{"uuid": "8cd8f344-7238-4b95-a009-acca7a9670f6"}]}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:52:49.762012 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.network.neutron [None req-1e9294ad-6807-46e4-96a9-9c9b2875a24b tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] validate_networks() for [('8cd8f344-7238-4b95-a009-acca7a9670f6', None, None, None, None, None)] {{(pid=117780) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:52:50.221510 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-1e9294ad-6807-46e4-96a9-9c9b2875a24b tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Flavor limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:52:50.221932 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-1e9294ad-6807-46e4-96a9-9c9b2875a24b tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Image limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:52:50.222410 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-1e9294ad-6807-46e4-96a9-9c9b2875a24b tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Flavor pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:52:50.222812 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-1e9294ad-6807-46e4-96a9-9c9b2875a24b tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Image pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:52:50.223252 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-1e9294ad-6807-46e4-96a9-9c9b2875a24b tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:52:50.234874 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e9294ad-6807-46e4-96a9-9c9b2875a24b tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:50.235920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e9294ad-6807-46e4-96a9-9c9b2875a24b tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:50.237135 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e9294ad-6807-46e4-96a9-9c9b2875a24b tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:50.237843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e9294ad-6807-46e4-96a9-9c9b2875a24b tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:50.263289 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-1e9294ad-6807-46e4-96a9-9c9b2875a24b tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Getting quotas for project c2f907cffd2047aea54235f1c750f234. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:52:50.269565 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-1e9294ad-6807-46e4-96a9-9c9b2875a24b tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Getting quotas for user 91dd24f48d5843fb973b5a2ce726227f and project c2f907cffd2047aea54235f1c750f234. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:52:50.283806 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-36e6f391-fdd4-40d2-8416-1a809ad9112c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-931976341", "imageRef": "646bfb5d-ef25-404a-a432-35d4209840fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cc6dfff5-7af6-4fd0-8eff-af097b6ee41a"}], "security_groups": [{"name": "tempest-securitygroup--1368370543"}], "key_name": "tempest-keypair-523682687", "user_data": "}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:52:50.292157 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1e9294ad-6807-46e4-96a9-9c9b2875a24b tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Going to run 1 instances... {{(pid=117780) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:52:50.296003 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1e9294ad-6807-46e4-96a9-9c9b2875a24b tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='646bfb5d-ef25-404a-a432-35d4209840fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:52:50.361095 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1e9294ad-6807-46e4-96a9-9c9b2875a24b tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676885 Jul 27 07:52:50.367251 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 227/444] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 07:52:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 07:52:50.375388 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-11660c07-3eec-430c-ad18-5868d1b2cec8 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:50.376084 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-11660c07-3eec-430c-ad18-5868d1b2cec8 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:50.411675 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.network.neutron [None req-36e6f391-fdd4-40d2-8416-1a809ad9112c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] validate_networks() for [('cc6dfff5-7af6-4fd0-8eff-af097b6ee41a', None, None, None, None, None)] {{(pid=117779) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:52:50.456740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-11660c07-3eec-430c-ad18-5868d1b2cec8 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:50.465464 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-11660c07-3eec-430c-ad18-5868d1b2cec8 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1214 microversion: 2.1 time: 0.096880 Jul 27 07:52:50.466082 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 228/445] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:50 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:50.717754 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-969c2720-653b-42bf-9935-14d49d16550a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Action: 'create', calling method: .version_select at 0x7f19fe57a160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-506878589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCO60qxLENk2kJDbE7kJq1zi/YFB78EMIHSLHKfXQwf0kot7McFiYIjaCqLeSGz+rRX8uDvDpCswyW7LP47zfi5HecItebIZlfZgo6vnshIf6XulXgHarrir7IVCHuq14w=="}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:52:50.733759 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-969c2720-653b-42bf-9935-14d49d16550a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Getting quotas for project 479f452a345b4c219d32d2ad78183af6. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:52:50.737910 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-969c2720-653b-42bf-9935-14d49d16550a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Getting quotas for user 5efb3ea424f8450c883d4757545af18d and project 479f452a345b4c219d32d2ad78183af6. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:52:50.774468 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-969c2720-653b-42bf-9935-14d49d16550a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.284886 Jul 27 07:52:50.775847 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 229/446] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Jul 27 07:52:50 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:52:50.942751 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-36e6f391-fdd4-40d2-8416-1a809ad9112c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Flavor limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:52:50.943310 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-36e6f391-fdd4-40d2-8416-1a809ad9112c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Image limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:52:50.943891 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-36e6f391-fdd4-40d2-8416-1a809ad9112c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Flavor pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:52:50.944401 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-36e6f391-fdd4-40d2-8416-1a809ad9112c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Image pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:52:50.944893 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-36e6f391-fdd4-40d2-8416-1a809ad9112c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:52:50.958283 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-36e6f391-fdd4-40d2-8416-1a809ad9112c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:50.958836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-36e6f391-fdd4-40d2-8416-1a809ad9112c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:50.959743 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-36e6f391-fdd4-40d2-8416-1a809ad9112c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:50.960346 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-36e6f391-fdd4-40d2-8416-1a809ad9112c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:50.982520 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-36e6f391-fdd4-40d2-8416-1a809ad9112c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Getting quotas for project c8e43fa41dc8445abed15accf9163b32. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:52:50.987243 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-36e6f391-fdd4-40d2-8416-1a809ad9112c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Getting quotas for user cb1cee30bc59446d882880d978b78bc2 and project c8e43fa41dc8445abed15accf9163b32. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:52:50.999085 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-36e6f391-fdd4-40d2-8416-1a809ad9112c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Going to run 1 instances... {{(pid=117779) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:52:51.001446 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-36e6f391-fdd4-40d2-8416-1a809ad9112c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='646bfb5d-ef25-404a-a432-35d4209840fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:52:51.047399 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR oslo.messaging._drivers.impl_rabbit [None req-36e6f391-fdd4-40d2-8416-1a809ad9112c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [093f2785-09f7-4c80-8990-51c9f296c3cf] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 07:52:51.488287 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a240c017-83f1-44c2-b0bc-0c3b33eeee17 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:51.489508 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a240c017-83f1-44c2-b0bc-0c3b33eeee17 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:51.504785 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a240c017-83f1-44c2-b0bc-0c3b33eeee17 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:51.505566 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a240c017-83f1-44c2-b0bc-0c3b33eeee17 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:51.506820 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a240c017-83f1-44c2-b0bc-0c3b33eeee17 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:51.507194 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a240c017-83f1-44c2-b0bc-0c3b33eeee17 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:51.578648 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a240c017-83f1-44c2-b0bc-0c3b33eeee17 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:51.588097 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a240c017-83f1-44c2-b0bc-0c3b33eeee17 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1210 microversion: 2.1 time: 0.103935 Jul 27 07:52:51.589036 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 230/447] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:51 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:52:52.055311 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO oslo.messaging._drivers.impl_rabbit [None req-36e6f391-fdd4-40d2-8416-1a809ad9112c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [093f2785-09f7-4c80-8990-51c9f296c3cf] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 47298. Jul 27 07:52:52.060837 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-36e6f391-fdd4-40d2-8416-1a809ad9112c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.781990 Jul 27 07:52:52.061961 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 218/448] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 07:52:50 2022] POST /compute/v2.1/servers => generated 409 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 07:52:52.073555 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6efe5677-8059-4e06-992e-713c32643deb tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:52.076107 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6efe5677-8059-4e06-992e-713c32643deb tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:52.136750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6efe5677-8059-4e06-992e-713c32643deb tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:52.145087 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6efe5677-8059-4e06-992e-713c32643deb tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1244 microversion: 2.1 time: 0.075959 Jul 27 07:52:52.145852 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 231/449] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:52 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1244 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:52:52.360234 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-93735507-5be9-42b7-8d92-855acac7bf62 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:52.360859 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-93735507-5be9-42b7-8d92-855acac7bf62 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:52.367818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-93735507-5be9-42b7-8d92-855acac7bf62 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:52.368971 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-93735507-5be9-42b7-8d92-855acac7bf62 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:52.369760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-93735507-5be9-42b7-8d92-855acac7bf62 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:52.370266 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-93735507-5be9-42b7-8d92-855acac7bf62 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:52.590641 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-93735507-5be9-42b7-8d92-855acac7bf62 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:52.602786 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-93735507-5be9-42b7-8d92-855acac7bf62 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1593 microversion: 2.1 time: 0.248520 Jul 27 07:52:52.604882 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 219/450] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:52 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1593 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:52.610723 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fc2de836-3647-4a3e-97eb-dd0be154430f tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:52.611499 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fc2de836-3647-4a3e-97eb-dd0be154430f tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:52.622358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fc2de836-3647-4a3e-97eb-dd0be154430f tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:52.622856 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fc2de836-3647-4a3e-97eb-dd0be154430f tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:52.624043 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fc2de836-3647-4a3e-97eb-dd0be154430f tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:52.624552 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fc2de836-3647-4a3e-97eb-dd0be154430f tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:52.707346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fc2de836-3647-4a3e-97eb-dd0be154430f tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:52.716138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fc2de836-3647-4a3e-97eb-dd0be154430f tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1284 microversion: 2.1 time: 0.110489 Jul 27 07:52:52.717212 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 232/451] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:52 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:53.166549 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-85d23eb7-b4e3-44af-943c-78cd051f4af1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:53.167395 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-85d23eb7-b4e3-44af-943c-78cd051f4af1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:53.174153 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-85d23eb7-b4e3-44af-943c-78cd051f4af1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:53.174717 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-85d23eb7-b4e3-44af-943c-78cd051f4af1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:53.176610 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-85d23eb7-b4e3-44af-943c-78cd051f4af1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:53.177117 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-85d23eb7-b4e3-44af-943c-78cd051f4af1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:53.272291 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-85d23eb7-b4e3-44af-943c-78cd051f4af1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:53.285773 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-85d23eb7-b4e3-44af-943c-78cd051f4af1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1296 microversion: 2.1 time: 0.120818 Jul 27 07:52:53.299491 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 220/452] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:53 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1296 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:53.737623 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-76355105-b9a2-4a6f-8bc9-c54dd72d6532 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:53.738867 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-76355105-b9a2-4a6f-8bc9-c54dd72d6532 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:53.755693 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-76355105-b9a2-4a6f-8bc9-c54dd72d6532 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:53.756892 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-76355105-b9a2-4a6f-8bc9-c54dd72d6532 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:53.757996 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-76355105-b9a2-4a6f-8bc9-c54dd72d6532 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:53.759430 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-76355105-b9a2-4a6f-8bc9-c54dd72d6532 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:54.066529 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-76355105-b9a2-4a6f-8bc9-c54dd72d6532 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:54.077235 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-76355105-b9a2-4a6f-8bc9-c54dd72d6532 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1314 microversion: 2.1 time: 0.343355 Jul 27 07:52:54.078592 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 233/453] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:53 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:54.308842 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-4eaac4db-a9e2-4631-8f77-7e1bc878a88a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:54.310646 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-4eaac4db-a9e2-4631-8f77-7e1bc878a88a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:54.314344 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:54.325155 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4eaac4db-a9e2-4631-8f77-7e1bc878a88a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:54.326000 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4eaac4db-a9e2-4631-8f77-7e1bc878a88a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:54.327063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4eaac4db-a9e2-4631-8f77-7e1bc878a88a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:54.327710 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4eaac4db-a9e2-4631-8f77-7e1bc878a88a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:54.489704 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-4eaac4db-a9e2-4631-8f77-7e1bc878a88a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:54.501867 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-4eaac4db-a9e2-4631-8f77-7e1bc878a88a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1302 microversion: 2.1 time: 0.197121 Jul 27 07:52:54.521562 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 221/454] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:54 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1302 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:54.960850 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-50572af7-b1ae-4fba-a64c-4d5d53a23975 req-0605d161-85e5-475f-bedf-730e56a41d09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8783fff-eac8-4c8d-ac9b-54d3b0e71678", "tag": "1f5d8484-cb4b-4631-acc8-c9d9d61c1f61"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:52:55.020607 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-50572af7-b1ae-4fba-a64c-4d5d53a23975 req-0605d161-85e5-475f-bedf-730e56a41d09 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:55.023573 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-50572af7-b1ae-4fba-a64c-4d5d53a23975 req-0605d161-85e5-475f-bedf-730e56a41d09 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:55.045497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-50572af7-b1ae-4fba-a64c-4d5d53a23975 req-0605d161-85e5-475f-bedf-730e56a41d09 service nova] Creating event network-changed:1f5d8484-cb4b-4631-acc8-c9d9d61c1f61 for instance b8783fff-eac8-4c8d-ac9b-54d3b0e71678 on hv-cinder-82549 Jul 27 07:52:55.068327 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-50572af7-b1ae-4fba-a64c-4d5d53a23975 req-0605d161-85e5-475f-bedf-730e56a41d09 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105512 Jul 27 07:52:55.070028 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 234/455] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:52:55.099221 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ca1d0569-3874-4b68-a643-8db67d4554aa tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:55.100215 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ca1d0569-3874-4b68-a643-8db67d4554aa tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:55.107237 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ca1d0569-3874-4b68-a643-8db67d4554aa tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:55.107999 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ca1d0569-3874-4b68-a643-8db67d4554aa tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:55.109048 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ca1d0569-3874-4b68-a643-8db67d4554aa tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:55.109669 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ca1d0569-3874-4b68-a643-8db67d4554aa tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:55.302758 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-b8c20efc-fee6-46dc-bd62-4d298322437a req-9e45255a-1f96-4357-86d5-e2d2736acb49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe285eb7-17fb-48f0-b380-f21aeeb82332", "tag": "a6810efb-5496-44f0-a63c-6868e0e1ac93"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:52:55.325434 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-b8c20efc-fee6-46dc-bd62-4d298322437a req-9e45255a-1f96-4357-86d5-e2d2736acb49 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:55.325883 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-b8c20efc-fee6-46dc-bd62-4d298322437a req-9e45255a-1f96-4357-86d5-e2d2736acb49 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:55.347986 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-b8c20efc-fee6-46dc-bd62-4d298322437a req-9e45255a-1f96-4357-86d5-e2d2736acb49 service nova] Creating event network-changed:a6810efb-5496-44f0-a63c-6868e0e1ac93 for instance fe285eb7-17fb-48f0-b380-f21aeeb82332 on hv-cinder-82549 Jul 27 07:52:55.362865 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-b8c20efc-fee6-46dc-bd62-4d298322437a req-9e45255a-1f96-4357-86d5-e2d2736acb49 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063737 Jul 27 07:52:55.363308 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 235/456] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:52:55.539806 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-739b626c-e7a6-439a-a950-f0538dff6596 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:55.541374 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-739b626c-e7a6-439a-a950-f0538dff6596 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:55.552942 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-739b626c-e7a6-439a-a950-f0538dff6596 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:55.553748 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-739b626c-e7a6-439a-a950-f0538dff6596 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:55.554737 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-739b626c-e7a6-439a-a950-f0538dff6596 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:55.555392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-739b626c-e7a6-439a-a950-f0538dff6596 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:55.680195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ca1d0569-3874-4b68-a643-8db67d4554aa tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:55.695754 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ca1d0569-3874-4b68-a643-8db67d4554aa tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1314 microversion: 2.1 time: 0.600729 Jul 27 07:52:55.698017 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 222/457] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:55 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:56.391527 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-739b626c-e7a6-439a-a950-f0538dff6596 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:56.402356 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-739b626c-e7a6-439a-a950-f0538dff6596 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1370 microversion: 2.1 time: 0.866669 Jul 27 07:52:56.403326 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 236/458] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:55 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1370 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:52:56.719035 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-fd67022a-7198-44fd-aebc-eccb7be6d0a1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:56.719670 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-fd67022a-7198-44fd-aebc-eccb7be6d0a1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:56.739336 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fd67022a-7198-44fd-aebc-eccb7be6d0a1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:56.740298 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fd67022a-7198-44fd-aebc-eccb7be6d0a1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:56.741509 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fd67022a-7198-44fd-aebc-eccb7be6d0a1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:56.742103 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fd67022a-7198-44fd-aebc-eccb7be6d0a1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:56.998698 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-fd67022a-7198-44fd-aebc-eccb7be6d0a1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:57.007005 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-fd67022a-7198-44fd-aebc-eccb7be6d0a1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1314 microversion: 2.1 time: 0.292044 Jul 27 07:52:57.007684 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 223/459] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:56 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:57.182026 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-568f0e4f-b311-48a7-870d-d9ec549c05de req-0692c70f-1221-4496-93b4-dcc3217ecb73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a94a8a11-679a-4c4c-b46b-c4a323068eb7", "tag": "42c28b8b-6ebb-416e-b231-309016bdd31f"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:52:57.215303 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-568f0e4f-b311-48a7-870d-d9ec549c05de req-0692c70f-1221-4496-93b4-dcc3217ecb73 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:57.217522 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-568f0e4f-b311-48a7-870d-d9ec549c05de req-0692c70f-1221-4496-93b4-dcc3217ecb73 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:57.223879 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:57.234650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-568f0e4f-b311-48a7-870d-d9ec549c05de req-0692c70f-1221-4496-93b4-dcc3217ecb73 service nova] Creating event network-changed:42c28b8b-6ebb-416e-b231-309016bdd31f for instance a94a8a11-679a-4c4c-b46b-c4a323068eb7 on hv-cinder-82549 Jul 27 07:52:57.240539 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-568f0e4f-b311-48a7-870d-d9ec549c05de req-0692c70f-1221-4496-93b4-dcc3217ecb73 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062591 Jul 27 07:52:57.242356 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 237/460] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:52:57.444138 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ae6d7c8f-1696-49bd-87d0-16832e85d4e6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:57.444415 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ae6d7c8f-1696-49bd-87d0-16832e85d4e6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:57.451175 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ae6d7c8f-1696-49bd-87d0-16832e85d4e6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:57.451789 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ae6d7c8f-1696-49bd-87d0-16832e85d4e6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:57.452587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ae6d7c8f-1696-49bd-87d0-16832e85d4e6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:57.453026 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ae6d7c8f-1696-49bd-87d0-16832e85d4e6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:57.513161 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-61c124f9-bdc9-42fb-9516-ba6b425b2747 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-421261463"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:52:57.513865 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-61c124f9-bdc9-42fb-9516-ba6b425b2747 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:57.523727 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-61c124f9-bdc9-42fb-9516-ba6b425b2747 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:57.524996 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-61c124f9-bdc9-42fb-9516-ba6b425b2747 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:57.526236 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-61c124f9-bdc9-42fb-9516-ba6b425b2747 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:57.527036 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-61c124f9-bdc9-42fb-9516-ba6b425b2747 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:57.618166 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ae6d7c8f-1696-49bd-87d0-16832e85d4e6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:57.625899 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ae6d7c8f-1696-49bd-87d0-16832e85d4e6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1370 microversion: 2.1 time: 0.190702 Jul 27 07:52:57.627031 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 224/461] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:57 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:57.672922 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.network.security_group_api [None req-61c124f9-bdc9-42fb-9516-ba6b425b2747 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Adding security group 317f18a3-9a94-4860-a676-ab09055dcbca to port a6810efb-5496-44f0-a63c-6868e0e1ac93 Jul 27 07:52:58.031165 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-3fc67900-9aec-4c6a-a545-a82ce411d610 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:58.032684 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-3fc67900-9aec-4c6a-a545-a82ce411d610 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:58.041537 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3fc67900-9aec-4c6a-a545-a82ce411d610 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:58.042078 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3fc67900-9aec-4c6a-a545-a82ce411d610 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:58.042958 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3fc67900-9aec-4c6a-a545-a82ce411d610 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:58.043512 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3fc67900-9aec-4c6a-a545-a82ce411d610 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:58.106781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-61c124f9-bdc9-42fb-9516-ba6b425b2747 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "POST /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332/action" status: 202 len: 0 microversion: 2.1 time: 0.599421 Jul 27 07:52:58.108949 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 238/462] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Jul 27 07:52:57 2022] POST /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 07:52:58.117033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b8f5d4fd-7157-4cd7-9a05-f9c4460a3c81 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:58.117946 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b8f5d4fd-7157-4cd7-9a05-f9c4460a3c81 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:58.135141 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b8f5d4fd-7157-4cd7-9a05-f9c4460a3c81 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:58.135604 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b8f5d4fd-7157-4cd7-9a05-f9c4460a3c81 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:58.136611 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b8f5d4fd-7157-4cd7-9a05-f9c4460a3c81 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:58.137170 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b8f5d4fd-7157-4cd7-9a05-f9c4460a3c81 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:58.230534 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3fc67900-9aec-4c6a-a545-a82ce411d610 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:58.240965 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-3fc67900-9aec-4c6a-a545-a82ce411d610 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1314 microversion: 2.1 time: 0.215139 Jul 27 07:52:58.242049 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 225/463] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:58 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:52:58.254288 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-d7060e39-e2f6-434f-bf84-ddb83ac25224 req-e1fdb428-bfe2-4803-9233-81fb27b68364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe285eb7-17fb-48f0-b380-f21aeeb82332", "tag": "a6810efb-5496-44f0-a63c-6868e0e1ac93"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:52:58.265587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-d7060e39-e2f6-434f-bf84-ddb83ac25224 req-e1fdb428-bfe2-4803-9233-81fb27b68364 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:58.266617 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-d7060e39-e2f6-434f-bf84-ddb83ac25224 req-e1fdb428-bfe2-4803-9233-81fb27b68364 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:58.283138 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-d7060e39-e2f6-434f-bf84-ddb83ac25224 req-e1fdb428-bfe2-4803-9233-81fb27b68364 service nova] Creating event network-changed:a6810efb-5496-44f0-a63c-6868e0e1ac93 for instance fe285eb7-17fb-48f0-b380-f21aeeb82332 on hv-cinder-82549 Jul 27 07:52:58.288910 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-d7060e39-e2f6-434f-bf84-ddb83ac25224 req-e1fdb428-bfe2-4803-9233-81fb27b68364 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045282 Jul 27 07:52:58.289824 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 226/464] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:52:58.347338 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b8f5d4fd-7157-4cd7-9a05-f9c4460a3c81 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:58.356513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b8f5d4fd-7157-4cd7-9a05-f9c4460a3c81 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1639 microversion: 2.1 time: 0.243341 Jul 27 07:52:58.357024 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 239/465] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:58 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1639 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:52:58.648426 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-3a033201-a281-41b4-b4eb-91d548e94c37 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:58.649963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-3a033201-a281-41b4-b4eb-91d548e94c37 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:58.656004 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3a033201-a281-41b4-b4eb-91d548e94c37 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:58.656445 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3a033201-a281-41b4-b4eb-91d548e94c37 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:58.657207 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3a033201-a281-41b4-b4eb-91d548e94c37 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:58.657631 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3a033201-a281-41b4-b4eb-91d548e94c37 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:58.799311 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3a033201-a281-41b4-b4eb-91d548e94c37 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:58.807382 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-3a033201-a281-41b4-b4eb-91d548e94c37 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1370 microversion: 2.1 time: 0.162979 Jul 27 07:52:58.807969 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 227/466] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:58 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:52:59.262514 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-88b7ca2b-f84c-40c1-857a-874604b47eb0 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:59.263146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-88b7ca2b-f84c-40c1-857a-874604b47eb0 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:59.265529 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:52:59.270863 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-88b7ca2b-f84c-40c1-857a-874604b47eb0 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:59.271347 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-88b7ca2b-f84c-40c1-857a-874604b47eb0 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:59.272121 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-88b7ca2b-f84c-40c1-857a-874604b47eb0 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:59.272561 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-88b7ca2b-f84c-40c1-857a-874604b47eb0 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:59.412035 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-88b7ca2b-f84c-40c1-857a-874604b47eb0 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:52:59.420856 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-88b7ca2b-f84c-40c1-857a-874604b47eb0 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1314 microversion: 2.1 time: 0.162227 Jul 27 07:52:59.421430 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 240/467] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:59 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:52:59.828814 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e6230e2f-b025-4ca0-95dd-af06e5902967 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:52:59.829837 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e6230e2f-b025-4ca0-95dd-af06e5902967 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:52:59.838790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e6230e2f-b025-4ca0-95dd-af06e5902967 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:59.839782 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e6230e2f-b025-4ca0-95dd-af06e5902967 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:52:59.840597 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e6230e2f-b025-4ca0-95dd-af06e5902967 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:52:59.841216 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e6230e2f-b025-4ca0-95dd-af06e5902967 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:00.340143 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e6230e2f-b025-4ca0-95dd-af06e5902967 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:00.348919 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e6230e2f-b025-4ca0-95dd-af06e5902967 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1370 microversion: 2.1 time: 0.523701 Jul 27 07:53:00.349501 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 228/468] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:52:59 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1370 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:00.441651 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1f74e90f-1217-4bbc-b06b-e74edf0e828e tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:00.442252 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1f74e90f-1217-4bbc-b06b-e74edf0e828e tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:00.446079 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=4 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:00.451731 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1f74e90f-1217-4bbc-b06b-e74edf0e828e tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:00.452173 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1f74e90f-1217-4bbc-b06b-e74edf0e828e tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:00.452968 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1f74e90f-1217-4bbc-b06b-e74edf0e828e tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:00.453468 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1f74e90f-1217-4bbc-b06b-e74edf0e828e tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:00.633870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1f74e90f-1217-4bbc-b06b-e74edf0e828e tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:00.651193 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1f74e90f-1217-4bbc-b06b-e74edf0e828e tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1314 microversion: 2.1 time: 0.212467 Jul 27 07:53:00.651673 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 241/469] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:00 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:01.373277 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-73cc8bae-b4f8-42ac-bcfa-ca618df5a985 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:01.374197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-73cc8bae-b4f8-42ac-bcfa-ca618df5a985 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:01.376710 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=2 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:01.377537 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=10 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:01.383820 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-73cc8bae-b4f8-42ac-bcfa-ca618df5a985 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:01.384320 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-73cc8bae-b4f8-42ac-bcfa-ca618df5a985 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:01.385105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-73cc8bae-b4f8-42ac-bcfa-ca618df5a985 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:01.385542 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-73cc8bae-b4f8-42ac-bcfa-ca618df5a985 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:01.534332 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-73cc8bae-b4f8-42ac-bcfa-ca618df5a985 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:01.542917 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-73cc8bae-b4f8-42ac-bcfa-ca618df5a985 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1370 microversion: 2.1 time: 0.174273 Jul 27 07:53:01.543473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 229/470] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:01 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:01.672113 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-190f4b11-5b14-4c73-907b-c06792c72e83 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:01.672848 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-190f4b11-5b14-4c73-907b-c06792c72e83 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:01.679815 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-190f4b11-5b14-4c73-907b-c06792c72e83 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:01.680255 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-190f4b11-5b14-4c73-907b-c06792c72e83 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:01.681026 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-190f4b11-5b14-4c73-907b-c06792c72e83 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:01.681458 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-190f4b11-5b14-4c73-907b-c06792c72e83 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:01.815995 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-190f4b11-5b14-4c73-907b-c06792c72e83 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:01.823411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-190f4b11-5b14-4c73-907b-c06792c72e83 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1314 microversion: 2.1 time: 0.155149 Jul 27 07:53:01.823983 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 242/471] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:01 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:02.564641 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c088491b-2229-418c-9643-9f6ab4cbf4aa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:02.565256 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c088491b-2229-418c-9643-9f6ab4cbf4aa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:02.572906 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c088491b-2229-418c-9643-9f6ab4cbf4aa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:02.573360 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c088491b-2229-418c-9643-9f6ab4cbf4aa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:02.574162 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c088491b-2229-418c-9643-9f6ab4cbf4aa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:02.574602 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c088491b-2229-418c-9643-9f6ab4cbf4aa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:02.710084 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c088491b-2229-418c-9643-9f6ab4cbf4aa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:02.717593 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c088491b-2229-418c-9643-9f6ab4cbf4aa tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1370 microversion: 2.1 time: 0.156715 Jul 27 07:53:02.718081 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 230/472] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:02 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:02.844014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3c62be0a-eadf-491a-832f-9fd70dff94d1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:02.844627 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3c62be0a-eadf-491a-832f-9fd70dff94d1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:02.846620 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=14 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:02.852580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3c62be0a-eadf-491a-832f-9fd70dff94d1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:02.853537 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3c62be0a-eadf-491a-832f-9fd70dff94d1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:02.854302 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3c62be0a-eadf-491a-832f-9fd70dff94d1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:02.854737 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3c62be0a-eadf-491a-832f-9fd70dff94d1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:02.985342 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3c62be0a-eadf-491a-832f-9fd70dff94d1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:02.992690 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3c62be0a-eadf-491a-832f-9fd70dff94d1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1314 microversion: 2.1 time: 0.152539 Jul 27 07:53:02.993249 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 243/473] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:02 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:03.738801 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0157c077-c759-4957-a875-cd3aa682d4e1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:03.739352 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0157c077-c759-4957-a875-cd3aa682d4e1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:03.745770 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0157c077-c759-4957-a875-cd3aa682d4e1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:03.746284 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0157c077-c759-4957-a875-cd3aa682d4e1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:03.747075 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0157c077-c759-4957-a875-cd3aa682d4e1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:03.747506 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0157c077-c759-4957-a875-cd3aa682d4e1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:03.885684 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0157c077-c759-4957-a875-cd3aa682d4e1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:03.893220 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0157c077-c759-4957-a875-cd3aa682d4e1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1370 microversion: 2.1 time: 0.158300 Jul 27 07:53:03.893785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 231/474] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:03 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:04.014633 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-eb4a0ca9-2934-4813-a372-06e4aabc63c1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:04.015172 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-eb4a0ca9-2934-4813-a372-06e4aabc63c1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:04.022425 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb4a0ca9-2934-4813-a372-06e4aabc63c1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:04.022909 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb4a0ca9-2934-4813-a372-06e4aabc63c1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:04.023725 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb4a0ca9-2934-4813-a372-06e4aabc63c1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:04.024156 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb4a0ca9-2934-4813-a372-06e4aabc63c1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:04.170555 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-eb4a0ca9-2934-4813-a372-06e4aabc63c1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:04.178301 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-eb4a0ca9-2934-4813-a372-06e4aabc63c1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1314 microversion: 2.1 time: 0.167539 Jul 27 07:53:04.178975 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 244/475] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:04 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:04.209850 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-77e3b688-e0fa-4310-ba69-6f06af348190 req-c5065979-dada-44f4-87bd-8ac8a5baa450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8783fff-eac8-4c8d-ac9b-54d3b0e71678", "name": "network-vif-plugged", "status": "completed", "tag": "1f5d8484-cb4b-4631-acc8-c9d9d61c1f61"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:53:04.219668 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-77e3b688-e0fa-4310-ba69-6f06af348190 req-c5065979-dada-44f4-87bd-8ac8a5baa450 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:04.220251 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-77e3b688-e0fa-4310-ba69-6f06af348190 req-c5065979-dada-44f4-87bd-8ac8a5baa450 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:04.231744 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-77e3b688-e0fa-4310-ba69-6f06af348190 req-c5065979-dada-44f4-87bd-8ac8a5baa450 service nova] Creating event network-vif-plugged:1f5d8484-cb4b-4631-acc8-c9d9d61c1f61 for instance b8783fff-eac8-4c8d-ac9b-54d3b0e71678 on hv-cinder-82549 Jul 27 07:53:04.236892 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-77e3b688-e0fa-4310-ba69-6f06af348190 req-c5065979-dada-44f4-87bd-8ac8a5baa450 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030847 Jul 27 07:53:04.237471 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 232/476] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:53:04.913722 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a144d8f0-93d7-426c-b848-fbaeca5f8dab tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:04.914365 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a144d8f0-93d7-426c-b848-fbaeca5f8dab tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:04.921110 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a144d8f0-93d7-426c-b848-fbaeca5f8dab tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:04.921558 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a144d8f0-93d7-426c-b848-fbaeca5f8dab tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:04.922363 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a144d8f0-93d7-426c-b848-fbaeca5f8dab tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:04.922802 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a144d8f0-93d7-426c-b848-fbaeca5f8dab tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:05.051580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a144d8f0-93d7-426c-b848-fbaeca5f8dab tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:05.058939 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a144d8f0-93d7-426c-b848-fbaeca5f8dab tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1370 microversion: 2.1 time: 0.149176 Jul 27 07:53:05.059497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 245/477] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:04 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:05.201328 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-fd4ccf17-533c-4592-8bbf-b52ebe15dd38 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:05.202755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-fd4ccf17-533c-4592-8bbf-b52ebe15dd38 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:05.209368 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fd4ccf17-533c-4592-8bbf-b52ebe15dd38 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:05.209811 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fd4ccf17-533c-4592-8bbf-b52ebe15dd38 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:05.210597 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fd4ccf17-533c-4592-8bbf-b52ebe15dd38 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:05.211073 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fd4ccf17-533c-4592-8bbf-b52ebe15dd38 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:05.340763 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-fd4ccf17-533c-4592-8bbf-b52ebe15dd38 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:05.348293 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-fd4ccf17-533c-4592-8bbf-b52ebe15dd38 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1314 microversion: 2.1 time: 0.152166 Jul 27 07:53:05.349390 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 233/478] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:05 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:06.080087 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-69353c41-9854-41ba-89af-2e4b6ac37614 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:06.080700 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-69353c41-9854-41ba-89af-2e4b6ac37614 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:06.087389 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-69353c41-9854-41ba-89af-2e4b6ac37614 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:06.087838 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-69353c41-9854-41ba-89af-2e4b6ac37614 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:06.088615 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-69353c41-9854-41ba-89af-2e4b6ac37614 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:06.089053 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-69353c41-9854-41ba-89af-2e4b6ac37614 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:06.235016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-69353c41-9854-41ba-89af-2e4b6ac37614 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:06.243574 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-69353c41-9854-41ba-89af-2e4b6ac37614 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1370 microversion: 2.1 time: 0.167293 Jul 27 07:53:06.244357 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 246/479] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:06 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:06.369620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2a3ff09f-46a3-4e62-b4cd-3c7c4307d4ba tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:06.370228 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2a3ff09f-46a3-4e62-b4cd-3c7c4307d4ba tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:06.376775 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2a3ff09f-46a3-4e62-b4cd-3c7c4307d4ba tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:06.377224 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2a3ff09f-46a3-4e62-b4cd-3c7c4307d4ba tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:06.377985 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2a3ff09f-46a3-4e62-b4cd-3c7c4307d4ba tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:06.378421 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2a3ff09f-46a3-4e62-b4cd-3c7c4307d4ba tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:06.512995 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2a3ff09f-46a3-4e62-b4cd-3c7c4307d4ba tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:06.520458 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2a3ff09f-46a3-4e62-b4cd-3c7c4307d4ba tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1314 microversion: 2.1 time: 0.154761 Jul 27 07:53:06.521017 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 234/480] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:06 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:07.264205 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d029dad9-80c7-4c40-9f44-541bdebc67bd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:07.264789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d029dad9-80c7-4c40-9f44-541bdebc67bd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:07.271539 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d029dad9-80c7-4c40-9f44-541bdebc67bd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:07.271983 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d029dad9-80c7-4c40-9f44-541bdebc67bd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:07.272744 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d029dad9-80c7-4c40-9f44-541bdebc67bd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:07.273178 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d029dad9-80c7-4c40-9f44-541bdebc67bd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:07.404746 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d029dad9-80c7-4c40-9f44-541bdebc67bd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:07.412301 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d029dad9-80c7-4c40-9f44-541bdebc67bd tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1370 microversion: 2.1 time: 0.152740 Jul 27 07:53:07.412864 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 247/481] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:07 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:07.541533 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-893d5f25-aaf3-4441-8825-107f52018082 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:07.542047 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-893d5f25-aaf3-4441-8825-107f52018082 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:07.548513 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-893d5f25-aaf3-4441-8825-107f52018082 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:07.548958 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-893d5f25-aaf3-4441-8825-107f52018082 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:07.549717 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-893d5f25-aaf3-4441-8825-107f52018082 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:07.550152 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-893d5f25-aaf3-4441-8825-107f52018082 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:07.554146 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:07.682067 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-893d5f25-aaf3-4441-8825-107f52018082 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:07.689448 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-893d5f25-aaf3-4441-8825-107f52018082 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1314 microversion: 2.1 time: 0.152396 Jul 27 07:53:07.690006 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 235/482] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:07 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:08.433492 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c2a20e12-3097-41c5-8367-18c91a618af3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:08.434107 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c2a20e12-3097-41c5-8367-18c91a618af3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:08.440723 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c2a20e12-3097-41c5-8367-18c91a618af3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:08.441173 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c2a20e12-3097-41c5-8367-18c91a618af3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:08.441939 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c2a20e12-3097-41c5-8367-18c91a618af3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:08.442377 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c2a20e12-3097-41c5-8367-18c91a618af3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:08.577477 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c2a20e12-3097-41c5-8367-18c91a618af3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:08.585262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c2a20e12-3097-41c5-8367-18c91a618af3 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1370 microversion: 2.1 time: 0.156066 Jul 27 07:53:08.585832 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 248/483] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:08 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:08.694086 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-9d0c3346-569c-4113-b702-81ad73b5c4e7 req-149346d2-cd22-49f5-8213-e89a2f0367c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a94a8a11-679a-4c4c-b46b-c4a323068eb7", "name": "network-vif-plugged", "status": "completed", "tag": "42c28b8b-6ebb-416e-b231-309016bdd31f"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:53:08.704881 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-9d0c3346-569c-4113-b702-81ad73b5c4e7 req-149346d2-cd22-49f5-8213-e89a2f0367c3 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:08.705331 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-9d0c3346-569c-4113-b702-81ad73b5c4e7 req-149346d2-cd22-49f5-8213-e89a2f0367c3 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:08.710209 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0e69e1d9-22b3-414a-b2c5-59a24c2fa96d tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:08.710809 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0e69e1d9-22b3-414a-b2c5-59a24c2fa96d tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:08.716725 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-9d0c3346-569c-4113-b702-81ad73b5c4e7 req-149346d2-cd22-49f5-8213-e89a2f0367c3 service nova] Creating event network-vif-plugged:42c28b8b-6ebb-416e-b231-309016bdd31f for instance a94a8a11-679a-4c4c-b46b-c4a323068eb7 on hv-cinder-82549 Jul 27 07:53:08.717463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0e69e1d9-22b3-414a-b2c5-59a24c2fa96d tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:08.717912 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0e69e1d9-22b3-414a-b2c5-59a24c2fa96d tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:08.718728 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0e69e1d9-22b3-414a-b2c5-59a24c2fa96d tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:08.719209 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0e69e1d9-22b3-414a-b2c5-59a24c2fa96d tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:08.721925 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-9d0c3346-569c-4113-b702-81ad73b5c4e7 req-149346d2-cd22-49f5-8213-e89a2f0367c3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031431 Jul 27 07:53:08.722542 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 236/484] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:53:08.857044 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0e69e1d9-22b3-414a-b2c5-59a24c2fa96d tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:08.865147 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0e69e1d9-22b3-414a-b2c5-59a24c2fa96d tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1499 microversion: 2.1 time: 0.159097 Jul 27 07:53:08.866083 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 249/485] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:08 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1499 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:53:09.487728 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-abed77d0-846a-45c9-912e-3dd2a85958fa tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:09.488272 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-abed77d0-846a-45c9-912e-3dd2a85958fa tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:09.494670 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-abed77d0-846a-45c9-912e-3dd2a85958fa tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:09.495147 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-abed77d0-846a-45c9-912e-3dd2a85958fa tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:09.496030 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-abed77d0-846a-45c9-912e-3dd2a85958fa tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:09.496360 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-abed77d0-846a-45c9-912e-3dd2a85958fa tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:09.523619 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-abed77d0-846a-45c9-912e-3dd2a85958fa tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Going to try to terminate instance {{(pid=117779) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 07:53:09.606707 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-626345f4-786f-472d-bb28-26e8057fd04d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:09.607445 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-626345f4-786f-472d-bb28-26e8057fd04d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:09.608154 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-abed77d0-846a-45c9-912e-3dd2a85958fa tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 204 len: 0 microversion: 2.1 time: 0.124176 Jul 27 07:53:09.608804 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 237/486] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 07:53:09 2022] DELETE /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 07:53:09.616899 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-626345f4-786f-472d-bb28-26e8057fd04d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:09.617237 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-49c3d719-1709-4be1-83eb-cc93e6e8f96f tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:09.617363 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-626345f4-786f-472d-bb28-26e8057fd04d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:09.617937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-49c3d719-1709-4be1-83eb-cc93e6e8f96f tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:09.618339 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-626345f4-786f-472d-bb28-26e8057fd04d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:09.619463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-626345f4-786f-472d-bb28-26e8057fd04d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:09.624990 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-49c3d719-1709-4be1-83eb-cc93e6e8f96f tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:09.625374 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-49c3d719-1709-4be1-83eb-cc93e6e8f96f tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:09.626142 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-49c3d719-1709-4be1-83eb-cc93e6e8f96f tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:09.626579 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-49c3d719-1709-4be1-83eb-cc93e6e8f96f tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:09.753010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-626345f4-786f-472d-bb28-26e8057fd04d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:09.757250 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-49c3d719-1709-4be1-83eb-cc93e6e8f96f tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:09.761362 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-626345f4-786f-472d-bb28-26e8057fd04d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1370 microversion: 2.1 time: 0.159719 Jul 27 07:53:09.762031 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 250/487] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:09 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:53:09.765035 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-49c3d719-1709-4be1-83eb-cc93e6e8f96f tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1505 microversion: 2.1 time: 0.151746 Jul 27 07:53:09.765591 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 238/488] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:09 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:53:10.782101 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-127b55e6-aaee-409e-98ac-7a526e30001f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:10.782993 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-127b55e6-aaee-409e-98ac-7a526e30001f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:10.786880 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-83e33ddf-b735-4da8-aa83-f5faaa8774bc tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:10.787518 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-83e33ddf-b735-4da8-aa83-f5faaa8774bc tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:10.789312 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-127b55e6-aaee-409e-98ac-7a526e30001f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:10.789761 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-127b55e6-aaee-409e-98ac-7a526e30001f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:10.791175 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-127b55e6-aaee-409e-98ac-7a526e30001f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:10.791616 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-127b55e6-aaee-409e-98ac-7a526e30001f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:10.794571 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-83e33ddf-b735-4da8-aa83-f5faaa8774bc tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:10.795061 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-83e33ddf-b735-4da8-aa83-f5faaa8774bc tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:10.795836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-83e33ddf-b735-4da8-aa83-f5faaa8774bc tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:10.796272 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-83e33ddf-b735-4da8-aa83-f5faaa8774bc tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:10.929340 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-127b55e6-aaee-409e-98ac-7a526e30001f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:10.934848 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-83e33ddf-b735-4da8-aa83-f5faaa8774bc tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:10.939088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-127b55e6-aaee-409e-98ac-7a526e30001f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1370 microversion: 2.1 time: 0.160637 Jul 27 07:53:10.940002 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 251/489] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:10 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:10.942977 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-83e33ddf-b735-4da8-aa83-f5faaa8774bc tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1505 microversion: 2.1 time: 0.160475 Jul 27 07:53:10.943668 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 239/490] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:10 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:53:11.960223 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c6dd1cc1-b70e-4cf5-8de7-91f0a1b9c1f5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:11.960834 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c6dd1cc1-b70e-4cf5-8de7-91f0a1b9c1f5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:11.963443 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f5dd6172-292c-4e61-99b8-764d1391cc28 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:11.964052 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f5dd6172-292c-4e61-99b8-764d1391cc28 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:11.967416 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c6dd1cc1-b70e-4cf5-8de7-91f0a1b9c1f5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:11.967871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c6dd1cc1-b70e-4cf5-8de7-91f0a1b9c1f5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:11.968646 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c6dd1cc1-b70e-4cf5-8de7-91f0a1b9c1f5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:11.969084 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c6dd1cc1-b70e-4cf5-8de7-91f0a1b9c1f5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:11.970485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f5dd6172-292c-4e61-99b8-764d1391cc28 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:11.970949 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f5dd6172-292c-4e61-99b8-764d1391cc28 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:11.971705 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f5dd6172-292c-4e61-99b8-764d1391cc28 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:11.972136 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f5dd6172-292c-4e61-99b8-764d1391cc28 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:12.108830 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c6dd1cc1-b70e-4cf5-8de7-91f0a1b9c1f5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:12.108999 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f5dd6172-292c-4e61-99b8-764d1391cc28 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:12.116852 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f5dd6172-292c-4e61-99b8-764d1391cc28 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1505 microversion: 2.1 time: 0.157018 Jul 27 07:53:12.117552 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 240/491] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:11 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:53:12.117716 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c6dd1cc1-b70e-4cf5-8de7-91f0a1b9c1f5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1370 microversion: 2.1 time: 0.161298 Jul 27 07:53:12.118903 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 252/492] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:11 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:12.858107 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-125c27b5-76d5-41dc-a850-7345c462dbcf req-d76ba2e7-35c3-45d9-b8a9-caea2aafdb85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8783fff-eac8-4c8d-ac9b-54d3b0e71678", "name": "network-vif-deleted", "tag": "1f5d8484-cb4b-4631-acc8-c9d9d61c1f61"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:53:12.867635 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-125c27b5-76d5-41dc-a850-7345c462dbcf req-d76ba2e7-35c3-45d9-b8a9-caea2aafdb85 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:12.868634 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-125c27b5-76d5-41dc-a850-7345c462dbcf req-d76ba2e7-35c3-45d9-b8a9-caea2aafdb85 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:12.879531 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-125c27b5-76d5-41dc-a850-7345c462dbcf req-d76ba2e7-35c3-45d9-b8a9-caea2aafdb85 service nova] Creating event network-vif-deleted:1f5d8484-cb4b-4631-acc8-c9d9d61c1f61 for instance b8783fff-eac8-4c8d-ac9b-54d3b0e71678 on hv-cinder-82549 Jul 27 07:53:12.885742 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-125c27b5-76d5-41dc-a850-7345c462dbcf req-d76ba2e7-35c3-45d9-b8a9-caea2aafdb85 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031009 Jul 27 07:53:12.886431 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 241/493] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:53:13.140002 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-aa88d507-ecb4-4619-a34f-800e80011e82 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:13.140616 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-aa88d507-ecb4-4619-a34f-800e80011e82 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:13.141899 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-4c0f49ac-d248-49a5-8a93-8d26e6bef700 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:13.142698 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-4c0f49ac-d248-49a5-8a93-8d26e6bef700 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:13.147329 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aa88d507-ecb4-4619-a34f-800e80011e82 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:13.147719 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aa88d507-ecb4-4619-a34f-800e80011e82 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:13.148518 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aa88d507-ecb4-4619-a34f-800e80011e82 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:13.148960 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aa88d507-ecb4-4619-a34f-800e80011e82 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:13.149092 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4c0f49ac-d248-49a5-8a93-8d26e6bef700 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:13.149551 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4c0f49ac-d248-49a5-8a93-8d26e6bef700 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:13.150927 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4c0f49ac-d248-49a5-8a93-8d26e6bef700 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:13.150927 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4c0f49ac-d248-49a5-8a93-8d26e6bef700 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:13.218431 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-4c0f49ac-d248-49a5-8a93-8d26e6bef700 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:13.228315 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-4c0f49ac-d248-49a5-8a93-8d26e6bef700 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 200 len: 1463 microversion: 2.1 time: 0.091109 Jul 27 07:53:13.228912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 242/494] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:13 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 1463 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:53:13.298602 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-aa88d507-ecb4-4619-a34f-800e80011e82 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:13.307262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-aa88d507-ecb4-4619-a34f-800e80011e82 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1370 microversion: 2.1 time: 0.171148 Jul 27 07:53:13.307850 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 253/495] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:13 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:14.249520 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-38b73e89-7c5e-417d-9105-a365130f31fd tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:14.250148 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-38b73e89-7c5e-417d-9105-a365130f31fd tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: b8783fff-eac8-4c8d-ac9b-54d3b0e71678] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:14.256694 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-38b73e89-7c5e-417d-9105-a365130f31fd tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:14.257136 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-38b73e89-7c5e-417d-9105-a365130f31fd tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:14.257902 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-38b73e89-7c5e-417d-9105-a365130f31fd tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:14.258335 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-38b73e89-7c5e-417d-9105-a365130f31fd tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:14.274878 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-38b73e89-7c5e-417d-9105-a365130f31fd tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] HTTP exception thrown: Instance b8783fff-eac8-4c8d-ac9b-54d3b0e71678 could not be found. Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-38b73e89-7c5e-417d-9105-a365130f31fd tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Request method failure captured: Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 HTTP/1.1 Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O7PQM9PdnjoSIdqvgI2FNdKMynIJ_LHwAvmHu4CCgcZsIPW4KxTp1sdnocIkAtfrQ1DOnOvd3K2HzIhLNOKUqcE8hDIDOQttfbBAxQskfyFD_Eb3QSjXAjBHzJ1Pi_IVOXd9j4n0-7tddnsTnCmHMkBy8D-MIf7ECiSciwGt3Fu5Lo Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: c2f907cffd2047aea54235f1c750f234 Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-VolumesActionsTest-869344110 Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 07:53:14.277661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 07:53:14.279524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c2f907cffd2047aea54235f1c750f234"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c2f907cffd2047aea54235f1c750f234"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c2f907cffd2047aea54235f1c750f234"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c2f907cffd2047aea54235f1c750f234"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:53:14.279524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-VolumesActionsTest-869344110 Jul 27 07:53:14.279524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: c2f907cffd2047aea54235f1c750f234 Jul 27 07:53:14.279524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-VolumesActionsTest-869344110 Jul 27 07:53:14.279524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-VolumesActionsTest-869344110-project Jul 27 07:53:14.279524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 07:53:14.279524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 07:53:14.279524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: 91dd24f48d5843fb973b5a2ce726227f Jul 27 07:53:14.279524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-VolumesActionsTest-869344110-project Jul 27 07:53:14.279524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 07:53:14.279524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Instance b8783fff-eac8-4c8d-ac9b-54d3b0e71678 could not be found. Jul 27 07:53:14.279524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': 'b8783fff-eac8-4c8d-ac9b-54d3b0e71678'} Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8783fff-eac8-4c8d-ac9b-54d3b0e71678 could not be found. Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:53:14.280851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:53:14.283564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:53:14.283564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 07:53:14.283564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 07:53:14.283564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 07:53:14.283564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 07:53:14.283564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 07:53:14.283564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:53:14.283564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8783fff-eac8-4c8d-ac9b-54d3b0e71678 could not be found. Jul 27 07:53:14.283564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:53:14.283564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:53:14.283564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:53:14.283564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:53:14.283564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:53:14.283564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:53:14.283564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:53:14.283564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:53:14.283564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8783fff-eac8-4c8d-ac9b-54d3b0e71678 could not be found. Jul 27 07:53:14.283564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:53:14.285043 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-38b73e89-7c5e-417d-9105-a365130f31fd tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Returning 404 to user: Instance b8783fff-eac8-4c8d-ac9b-54d3b0e71678 could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:53:14.285043 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-38b73e89-7c5e-417d-9105-a365130f31fd tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678" status: 404 len: 111 microversion: 2.1 time: 0.033551 Jul 27 07:53:14.285043 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 243/496] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:14 2022] GET /compute/v2.1/servers/b8783fff-eac8-4c8d-ac9b-54d3b0e71678 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 07:53:14.329175 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-26eb6929-86cf-4cb2-9031-cc19eee8f504 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:14.329782 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-26eb6929-86cf-4cb2-9031-cc19eee8f504 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:14.330344 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d835f132-73ee-450b-abe0-8fe283dba435 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1271250721", "imageRef": "646bfb5d-ef25-404a-a432-35d4209840fd", "flavorRef": "452", "networks": [{"uuid": "8cd8f344-7238-4b95-a009-acca7a9670f6"}]}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:53:14.336495 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-26eb6929-86cf-4cb2-9031-cc19eee8f504 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:14.336936 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-26eb6929-86cf-4cb2-9031-cc19eee8f504 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:14.337691 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-26eb6929-86cf-4cb2-9031-cc19eee8f504 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:14.338806 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-26eb6929-86cf-4cb2-9031-cc19eee8f504 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:14.386801 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.network.neutron [None req-d835f132-73ee-450b-abe0-8fe283dba435 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] validate_networks() for [('8cd8f344-7238-4b95-a009-acca7a9670f6', None, None, None, None, None)] {{(pid=117779) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:53:14.475209 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-26eb6929-86cf-4cb2-9031-cc19eee8f504 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:14.478732 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:14.483955 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-26eb6929-86cf-4cb2-9031-cc19eee8f504 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1564 microversion: 2.1 time: 0.158502 Jul 27 07:53:14.484824 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 254/497] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:14 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:14.504814 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-51cb4a17-44ca-4f49-90f1-7dab191bb512 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:14.505315 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-51cb4a17-44ca-4f49-90f1-7dab191bb512 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:14.512049 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-51cb4a17-44ca-4f49-90f1-7dab191bb512 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:14.512491 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-51cb4a17-44ca-4f49-90f1-7dab191bb512 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:14.513261 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-51cb4a17-44ca-4f49-90f1-7dab191bb512 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:14.513701 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-51cb4a17-44ca-4f49-90f1-7dab191bb512 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:14.594153 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-51cb4a17-44ca-4f49-90f1-7dab191bb512 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093040 Jul 27 07:53:14.594913 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 255/498] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Jul 27 07:53:14 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:53:14.753950 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-d835f132-73ee-450b-abe0-8fe283dba435 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Flavor limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:53:14.754488 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-d835f132-73ee-450b-abe0-8fe283dba435 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Image limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:53:14.755063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-d835f132-73ee-450b-abe0-8fe283dba435 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Flavor pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:53:14.755535 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-d835f132-73ee-450b-abe0-8fe283dba435 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Image pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:53:14.756028 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-d835f132-73ee-450b-abe0-8fe283dba435 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:53:14.764753 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d835f132-73ee-450b-abe0-8fe283dba435 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:14.765191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d835f132-73ee-450b-abe0-8fe283dba435 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:14.765974 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d835f132-73ee-450b-abe0-8fe283dba435 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:14.766427 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d835f132-73ee-450b-abe0-8fe283dba435 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:14.783501 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-d835f132-73ee-450b-abe0-8fe283dba435 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Getting quotas for project c2f907cffd2047aea54235f1c750f234. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:53:14.787883 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-d835f132-73ee-450b-abe0-8fe283dba435 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Getting quotas for user 91dd24f48d5843fb973b5a2ce726227f and project c2f907cffd2047aea54235f1c750f234. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:53:14.801213 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d835f132-73ee-450b-abe0-8fe283dba435 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Going to run 1 instances... {{(pid=117779) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:53:14.803519 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d835f132-73ee-450b-abe0-8fe283dba435 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='646bfb5d-ef25-404a-a432-35d4209840fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:53:14.856294 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d835f132-73ee-450b-abe0-8fe283dba435 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528605 Jul 27 07:53:14.857457 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 244/499] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 07:53:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 07:53:14.867839 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d0e383e6-4aa4-4417-93e8-58938357f6c9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:14.868455 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d0e383e6-4aa4-4417-93e8-58938357f6c9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:14.979298 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d0e383e6-4aa4-4417-93e8-58938357f6c9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:14.986957 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d0e383e6-4aa4-4417-93e8-58938357f6c9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 200 len: 1214 microversion: 2.1 time: 0.122855 Jul 27 07:53:14.987544 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 256/500] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:14 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 1214 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:15.623444 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-b517241d-6ef4-45a3-a3b5-25cbe6e8f6f8 req-16cbd027-c71a-4b0d-a00c-72f34195ba92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a94a8a11-679a-4c4c-b46b-c4a323068eb7", "tag": "42c28b8b-6ebb-416e-b231-309016bdd31f"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:53:15.632931 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-b517241d-6ef4-45a3-a3b5-25cbe6e8f6f8 req-16cbd027-c71a-4b0d-a00c-72f34195ba92 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:15.633363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-b517241d-6ef4-45a3-a3b5-25cbe6e8f6f8 req-16cbd027-c71a-4b0d-a00c-72f34195ba92 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:15.644878 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-b517241d-6ef4-45a3-a3b5-25cbe6e8f6f8 req-16cbd027-c71a-4b0d-a00c-72f34195ba92 service nova] Creating event network-changed:42c28b8b-6ebb-416e-b231-309016bdd31f for instance a94a8a11-679a-4c4c-b46b-c4a323068eb7 on hv-cinder-82549 Jul 27 07:53:15.649747 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-b517241d-6ef4-45a3-a3b5-25cbe6e8f6f8 req-16cbd027-c71a-4b0d-a00c-72f34195ba92 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030418 Jul 27 07:53:15.650331 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 245/501] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:53:16.009824 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-32417ef4-89a1-4585-8e8d-b04eac63a9da tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:16.011022 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-32417ef4-89a1-4585-8e8d-b04eac63a9da tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:16.018387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-32417ef4-89a1-4585-8e8d-b04eac63a9da tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:16.019097 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-32417ef4-89a1-4585-8e8d-b04eac63a9da tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:16.020061 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-32417ef4-89a1-4585-8e8d-b04eac63a9da tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:16.020637 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-32417ef4-89a1-4585-8e8d-b04eac63a9da tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:16.086696 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-32417ef4-89a1-4585-8e8d-b04eac63a9da tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:16.094578 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-32417ef4-89a1-4585-8e8d-b04eac63a9da tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 200 len: 1274 microversion: 2.1 time: 0.088721 Jul 27 07:53:16.099252 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 257/502] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:16 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:17.121465 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2a091789-be19-43c8-89bf-1c87256078a4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:17.122170 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2a091789-be19-43c8-89bf-1c87256078a4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:17.128652 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2a091789-be19-43c8-89bf-1c87256078a4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:17.129096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2a091789-be19-43c8-89bf-1c87256078a4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:17.129878 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2a091789-be19-43c8-89bf-1c87256078a4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:17.130317 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2a091789-be19-43c8-89bf-1c87256078a4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:17.208143 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2a091789-be19-43c8-89bf-1c87256078a4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:17.216372 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2a091789-be19-43c8-89bf-1c87256078a4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 200 len: 1272 microversion: 2.1 time: 0.099624 Jul 27 07:53:17.216951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 246/503] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:17 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:18.046815 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-fd4fadce-aaeb-4b24-b571-91e76dec578a req-cc49865e-56d0-4793-b109-4b08305497b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ccad593-afaa-4045-8e25-b0f0a17368e4", "tag": "aea5cf6d-44db-464b-a6c7-6f193f601693"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:53:18.057536 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-fd4fadce-aaeb-4b24-b571-91e76dec578a req-cc49865e-56d0-4793-b109-4b08305497b5 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:18.058517 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-fd4fadce-aaeb-4b24-b571-91e76dec578a req-cc49865e-56d0-4793-b109-4b08305497b5 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:18.076614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-fd4fadce-aaeb-4b24-b571-91e76dec578a req-cc49865e-56d0-4793-b109-4b08305497b5 service nova] Creating event network-changed:aea5cf6d-44db-464b-a6c7-6f193f601693 for instance 1ccad593-afaa-4045-8e25-b0f0a17368e4 on hv-cinder-82549 Jul 27 07:53:18.081329 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-fd4fadce-aaeb-4b24-b571-91e76dec578a req-cc49865e-56d0-4793-b109-4b08305497b5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038287 Jul 27 07:53:18.081928 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 258/504] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:53:18.237520 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-58306c68-8643-481d-ac36-a1dcd15a183e tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:18.238128 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-58306c68-8643-481d-ac36-a1dcd15a183e tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:18.244627 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-58306c68-8643-481d-ac36-a1dcd15a183e tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:18.245064 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-58306c68-8643-481d-ac36-a1dcd15a183e tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:18.245823 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-58306c68-8643-481d-ac36-a1dcd15a183e tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:18.246662 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-58306c68-8643-481d-ac36-a1dcd15a183e tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:18.460831 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-58306c68-8643-481d-ac36-a1dcd15a183e tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:18.469245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-58306c68-8643-481d-ac36-a1dcd15a183e tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 200 len: 1314 microversion: 2.1 time: 0.235513 Jul 27 07:53:18.469813 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 247/505] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:18 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:19.029754 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-351830cc-558a-4247-88a7-74ea5150167e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1604923885", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-506878589", "security_groups": [{"name": "tempest-secgroup-smoke-844798545"}], "block_device_mapping_v2": [{"uuid": "8b7c7b08-2118-43be-8b25-9ffe013d6094", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6f4c8516-f20c-40ca-8fd7-7c9a143ac3f6"}]}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:53:19.141813 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.network.neutron [None req-351830cc-558a-4247-88a7-74ea5150167e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] validate_networks() for [('6f4c8516-f20c-40ca-8fd7-7c9a143ac3f6', None, None, None, None, None)] {{(pid=117780) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:53:19.490803 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ac7e950f-76cb-4c5e-987b-d687a135ac96 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:19.491563 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ac7e950f-76cb-4c5e-987b-d687a135ac96 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:19.498776 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ac7e950f-76cb-4c5e-987b-d687a135ac96 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:19.499260 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ac7e950f-76cb-4c5e-987b-d687a135ac96 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:19.500037 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ac7e950f-76cb-4c5e-987b-d687a135ac96 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:19.500470 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ac7e950f-76cb-4c5e-987b-d687a135ac96 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:19.516622 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-351830cc-558a-4247-88a7-74ea5150167e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Flavor limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:53:19.517048 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-351830cc-558a-4247-88a7-74ea5150167e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Image limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:53:19.517673 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-351830cc-558a-4247-88a7-74ea5150167e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Flavor pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:53:19.518085 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-351830cc-558a-4247-88a7-74ea5150167e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Image pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:53:19.518493 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-351830cc-558a-4247-88a7-74ea5150167e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:53:19.527596 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-351830cc-558a-4247-88a7-74ea5150167e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:19.528045 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-351830cc-558a-4247-88a7-74ea5150167e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:19.528841 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-351830cc-558a-4247-88a7-74ea5150167e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:19.529267 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-351830cc-558a-4247-88a7-74ea5150167e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:19.550249 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-351830cc-558a-4247-88a7-74ea5150167e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Getting quotas for project 479f452a345b4c219d32d2ad78183af6. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:53:19.555312 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-351830cc-558a-4247-88a7-74ea5150167e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Getting quotas for user 5efb3ea424f8450c883d4757545af18d and project 479f452a345b4c219d32d2ad78183af6. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:53:19.615328 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-351830cc-558a-4247-88a7-74ea5150167e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Going to run 1 instances... {{(pid=117780) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:53:19.618024 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-351830cc-558a-4247-88a7-74ea5150167e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b7c7b08-2118-43be-8b25-9ffe013d6094',volume_size=None,volume_type=None)] {{(pid=117780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:53:19.636809 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ac7e950f-76cb-4c5e-987b-d687a135ac96 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:19.644579 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ac7e950f-76cb-4c5e-987b-d687a135ac96 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 200 len: 1314 microversion: 2.1 time: 0.157584 Jul 27 07:53:19.645252 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 248/506] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:19 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:53:19.746344 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-351830cc-558a-4247-88a7-74ea5150167e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.720742 Jul 27 07:53:19.747031 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 259/507] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 07:53:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 07:53:19.757843 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c725f639-068a-43dc-a5d4-59ac343faff0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:19.758577 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c725f639-068a-43dc-a5d4-59ac343faff0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:19.815211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c725f639-068a-43dc-a5d4-59ac343faff0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:19.821803 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c725f639-068a-43dc-a5d4-59ac343faff0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1094 microversion: 2.1 time: 0.067737 Jul 27 07:53:19.822456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 249/508] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:19 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:20.666042 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-965fd0ec-146d-4ac1-9d50-d02b72560907 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:20.666690 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-965fd0ec-146d-4ac1-9d50-d02b72560907 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:20.673180 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-965fd0ec-146d-4ac1-9d50-d02b72560907 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:20.673624 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-965fd0ec-146d-4ac1-9d50-d02b72560907 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:20.674392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-965fd0ec-146d-4ac1-9d50-d02b72560907 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:20.674827 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-965fd0ec-146d-4ac1-9d50-d02b72560907 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:20.807220 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-965fd0ec-146d-4ac1-9d50-d02b72560907 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:20.814728 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-965fd0ec-146d-4ac1-9d50-d02b72560907 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 200 len: 1314 microversion: 2.1 time: 0.153062 Jul 27 07:53:20.815330 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 260/509] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:20 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:20.841790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a9cc180e-3d61-40f6-91a0-32adf085303d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:20.842393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a9cc180e-3d61-40f6-91a0-32adf085303d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:20.849670 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a9cc180e-3d61-40f6-91a0-32adf085303d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:20.850120 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a9cc180e-3d61-40f6-91a0-32adf085303d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:20.850922 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a9cc180e-3d61-40f6-91a0-32adf085303d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:20.851348 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a9cc180e-3d61-40f6-91a0-32adf085303d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:20.911190 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a9cc180e-3d61-40f6-91a0-32adf085303d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:20.919146 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a9cc180e-3d61-40f6-91a0-32adf085303d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1144 microversion: 2.1 time: 0.081139 Jul 27 07:53:20.919797 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 250/510] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:20 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:21.836065 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-499b934f-da21-49e6-88de-eb7de67a78e9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:21.836688 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-499b934f-da21-49e6-88de-eb7de67a78e9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:21.844297 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-499b934f-da21-49e6-88de-eb7de67a78e9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:21.844779 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-499b934f-da21-49e6-88de-eb7de67a78e9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:21.845519 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-499b934f-da21-49e6-88de-eb7de67a78e9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:21.846208 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-499b934f-da21-49e6-88de-eb7de67a78e9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:21.947854 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-da5322e4-9e22-4643-8780-1f31e004fcfa tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:21.949071 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-da5322e4-9e22-4643-8780-1f31e004fcfa tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:21.957112 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-da5322e4-9e22-4643-8780-1f31e004fcfa tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:21.958042 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-da5322e4-9e22-4643-8780-1f31e004fcfa tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:21.959786 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-da5322e4-9e22-4643-8780-1f31e004fcfa tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:21.960469 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-da5322e4-9e22-4643-8780-1f31e004fcfa tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:21.993758 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-499b934f-da21-49e6-88de-eb7de67a78e9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:22.001165 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-499b934f-da21-49e6-88de-eb7de67a78e9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 200 len: 1314 microversion: 2.1 time: 0.169300 Jul 27 07:53:22.001732 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 261/511] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:21 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:22.031586 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-da5322e4-9e22-4643-8780-1f31e004fcfa tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:22.039093 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-da5322e4-9e22-4643-8780-1f31e004fcfa tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1192 microversion: 2.1 time: 0.098028 Jul 27 07:53:22.039654 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 251/512] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:21 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1192 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:53:23.021813 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7deab857-d728-42a3-a2a6-f0cfe27cfa53 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:23.022363 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7deab857-d728-42a3-a2a6-f0cfe27cfa53 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:23.028795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7deab857-d728-42a3-a2a6-f0cfe27cfa53 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:23.029246 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7deab857-d728-42a3-a2a6-f0cfe27cfa53 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:23.030015 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7deab857-d728-42a3-a2a6-f0cfe27cfa53 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:23.030448 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7deab857-d728-42a3-a2a6-f0cfe27cfa53 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:23.061529 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-16c1992f-1e54-4848-b25d-c8a9d77f2f7c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:23.062560 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-16c1992f-1e54-4848-b25d-c8a9d77f2f7c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:23.070825 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-16c1992f-1e54-4848-b25d-c8a9d77f2f7c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:23.071410 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-16c1992f-1e54-4848-b25d-c8a9d77f2f7c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:23.072481 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-16c1992f-1e54-4848-b25d-c8a9d77f2f7c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:23.073100 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-16c1992f-1e54-4848-b25d-c8a9d77f2f7c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:23.173244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7deab857-d728-42a3-a2a6-f0cfe27cfa53 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:23.180835 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7deab857-d728-42a3-a2a6-f0cfe27cfa53 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 200 len: 1314 microversion: 2.1 time: 0.163018 Jul 27 07:53:23.181441 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 262/513] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:23 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:23.311754 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-16c1992f-1e54-4848-b25d-c8a9d77f2f7c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:23.335955 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-16c1992f-1e54-4848-b25d-c8a9d77f2f7c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1277 microversion: 2.1 time: 0.276576 Jul 27 07:53:23.336797 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 252/514] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:23 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1277 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:53:24.028932 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-2c7d7460-a48c-41ee-8866-a5a53a4a8963 req-e17cb874-d7b3-4515-9cf2-446733498564 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d599a647-2c57-4095-8875-7eb9ac54150f", "tag": "0e2e33bc-ba25-4cd3-9bd5-b56a3d33a66e"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:53:24.039815 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-2c7d7460-a48c-41ee-8866-a5a53a4a8963 req-e17cb874-d7b3-4515-9cf2-446733498564 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:24.040009 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-2c7d7460-a48c-41ee-8866-a5a53a4a8963 req-e17cb874-d7b3-4515-9cf2-446733498564 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:24.052091 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-2c7d7460-a48c-41ee-8866-a5a53a4a8963 req-e17cb874-d7b3-4515-9cf2-446733498564 service nova] Creating event network-changed:0e2e33bc-ba25-4cd3-9bd5-b56a3d33a66e for instance d599a647-2c57-4095-8875-7eb9ac54150f on hv-cinder-82549 Jul 27 07:53:24.057661 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-2c7d7460-a48c-41ee-8866-a5a53a4a8963 req-e17cb874-d7b3-4515-9cf2-446733498564 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034622 Jul 27 07:53:24.058551 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 263/515] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:53:24.204033 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-eb6aed01-d15d-47b1-9019-fc6399d680c4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:24.205716 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-eb6aed01-d15d-47b1-9019-fc6399d680c4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:24.213786 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-eb6aed01-d15d-47b1-9019-fc6399d680c4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:24.214229 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-eb6aed01-d15d-47b1-9019-fc6399d680c4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:24.215025 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-eb6aed01-d15d-47b1-9019-fc6399d680c4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:24.215583 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-eb6aed01-d15d-47b1-9019-fc6399d680c4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:24.360295 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7a927ca1-6ab7-41ed-b75a-29a4af0905f6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:24.360975 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7a927ca1-6ab7-41ed-b75a-29a4af0905f6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:24.367708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7a927ca1-6ab7-41ed-b75a-29a4af0905f6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:24.368148 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7a927ca1-6ab7-41ed-b75a-29a4af0905f6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:24.369407 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7a927ca1-6ab7-41ed-b75a-29a4af0905f6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:24.369839 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7a927ca1-6ab7-41ed-b75a-29a4af0905f6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:24.432187 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-eb6aed01-d15d-47b1-9019-fc6399d680c4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:24.439634 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-eb6aed01-d15d-47b1-9019-fc6399d680c4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 200 len: 1314 microversion: 2.1 time: 0.240932 Jul 27 07:53:24.440400 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 253/516] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:24 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:24.503805 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7a927ca1-6ab7-41ed-b75a-29a4af0905f6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:24.511708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7a927ca1-6ab7-41ed-b75a-29a4af0905f6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1265 microversion: 2.1 time: 0.156784 Jul 27 07:53:24.512285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 264/517] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:24 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:53:25.009560 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-97815268-71fa-4f44-b4bf-a543d5bbb34f req-7c79f912-9dec-47a8-9fbc-ebb1bdb3245f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ccad593-afaa-4045-8e25-b0f0a17368e4", "name": "network-vif-plugged", "status": "completed", "tag": "aea5cf6d-44db-464b-a6c7-6f193f601693"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:53:25.015024 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=2 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:25.015956 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:25.023424 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-97815268-71fa-4f44-b4bf-a543d5bbb34f req-7c79f912-9dec-47a8-9fbc-ebb1bdb3245f service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:25.023865 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-97815268-71fa-4f44-b4bf-a543d5bbb34f req-7c79f912-9dec-47a8-9fbc-ebb1bdb3245f service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:25.036286 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-97815268-71fa-4f44-b4bf-a543d5bbb34f req-7c79f912-9dec-47a8-9fbc-ebb1bdb3245f service nova] Creating event network-vif-plugged:aea5cf6d-44db-464b-a6c7-6f193f601693 for instance 1ccad593-afaa-4045-8e25-b0f0a17368e4 on hv-cinder-82549 Jul 27 07:53:25.042007 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-97815268-71fa-4f44-b4bf-a543d5bbb34f req-7c79f912-9dec-47a8-9fbc-ebb1bdb3245f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035370 Jul 27 07:53:25.042612 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 254/518] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:53:25.461559 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9cadb18c-cd2b-4017-b5de-e3a9aee06b0d tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:25.462161 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9cadb18c-cd2b-4017-b5de-e3a9aee06b0d tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:25.469446 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9cadb18c-cd2b-4017-b5de-e3a9aee06b0d tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:25.469887 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9cadb18c-cd2b-4017-b5de-e3a9aee06b0d tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:25.470684 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9cadb18c-cd2b-4017-b5de-e3a9aee06b0d tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:25.471158 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9cadb18c-cd2b-4017-b5de-e3a9aee06b0d tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:25.534632 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ce1e9f0b-6b22-4cbf-9593-9c8cc80c1ef8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:25.535308 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ce1e9f0b-6b22-4cbf-9593-9c8cc80c1ef8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:25.542274 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ce1e9f0b-6b22-4cbf-9593-9c8cc80c1ef8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:25.542720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ce1e9f0b-6b22-4cbf-9593-9c8cc80c1ef8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:25.543525 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ce1e9f0b-6b22-4cbf-9593-9c8cc80c1ef8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:25.543969 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ce1e9f0b-6b22-4cbf-9593-9c8cc80c1ef8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:25.546709 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:25.605121 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9cadb18c-cd2b-4017-b5de-e3a9aee06b0d tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:25.612913 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9cadb18c-cd2b-4017-b5de-e3a9aee06b0d tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 200 len: 1314 microversion: 2.1 time: 0.155157 Jul 27 07:53:25.613602 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 265/519] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:25 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:25.679271 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ce1e9f0b-6b22-4cbf-9593-9c8cc80c1ef8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:25.686683 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ce1e9f0b-6b22-4cbf-9593-9c8cc80c1ef8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1265 microversion: 2.1 time: 0.157349 Jul 27 07:53:25.687278 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 255/520] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:25 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:26.634093 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-74b2d4d9-ec26-4e48-877f-f13d5e860ff9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:26.635358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-74b2d4d9-ec26-4e48-877f-f13d5e860ff9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:26.643265 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-74b2d4d9-ec26-4e48-877f-f13d5e860ff9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:26.643798 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-74b2d4d9-ec26-4e48-877f-f13d5e860ff9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:26.644474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-74b2d4d9-ec26-4e48-877f-f13d5e860ff9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:26.644903 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-74b2d4d9-ec26-4e48-877f-f13d5e860ff9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:26.707622 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-51d9b35a-e106-4230-954d-cdaff7cb3f38 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:26.708242 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-51d9b35a-e106-4230-954d-cdaff7cb3f38 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:26.714789 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-51d9b35a-e106-4230-954d-cdaff7cb3f38 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:26.715274 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-51d9b35a-e106-4230-954d-cdaff7cb3f38 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:26.716043 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-51d9b35a-e106-4230-954d-cdaff7cb3f38 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:26.716483 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-51d9b35a-e106-4230-954d-cdaff7cb3f38 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:26.790196 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-74b2d4d9-ec26-4e48-877f-f13d5e860ff9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:26.798772 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-74b2d4d9-ec26-4e48-877f-f13d5e860ff9 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 200 len: 1314 microversion: 2.1 time: 0.168487 Jul 27 07:53:26.799385 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 266/521] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:26 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:26.931269 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-51d9b35a-e106-4230-954d-cdaff7cb3f38 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:26.944260 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-51d9b35a-e106-4230-954d-cdaff7cb3f38 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1265 microversion: 2.1 time: 0.240364 Jul 27 07:53:26.944925 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 256/522] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:26 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:53:27.225230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a62407ae-4a2b-4da8-b37a-a9d216581952 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:27.225645 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a62407ae-4a2b-4da8-b37a-a9d216581952 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:27.232430 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a62407ae-4a2b-4da8-b37a-a9d216581952 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:27.232968 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a62407ae-4a2b-4da8-b37a-a9d216581952 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:27.233742 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a62407ae-4a2b-4da8-b37a-a9d216581952 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:27.234180 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a62407ae-4a2b-4da8-b37a-a9d216581952 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:27.256784 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a62407ae-4a2b-4da8-b37a-a9d216581952 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6/ips" status: 200 len: 151 microversion: 2.1 time: 0.036157 Jul 27 07:53:27.257352 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 267/523] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Jul 27 07:53:27 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:53:27.820452 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0ca6aa49-c316-46ca-a378-d2804a758ba8 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:27.821101 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0ca6aa49-c316-46ca-a378-d2804a758ba8 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:27.827666 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0ca6aa49-c316-46ca-a378-d2804a758ba8 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:27.828118 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0ca6aa49-c316-46ca-a378-d2804a758ba8 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:27.828882 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0ca6aa49-c316-46ca-a378-d2804a758ba8 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:27.829318 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0ca6aa49-c316-46ca-a378-d2804a758ba8 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:27.966001 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0ca6aa49-c316-46ca-a378-d2804a758ba8 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:27.966181 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3b6bc525-d298-442e-9e35-0e4791a8835f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:27.966678 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3b6bc525-d298-442e-9e35-0e4791a8835f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:27.973235 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b6bc525-d298-442e-9e35-0e4791a8835f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:27.973935 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b6bc525-d298-442e-9e35-0e4791a8835f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:27.974100 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0ca6aa49-c316-46ca-a378-d2804a758ba8 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 200 len: 1314 microversion: 2.1 time: 0.157393 Jul 27 07:53:27.974658 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 257/524] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:27 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:27.974774 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b6bc525-d298-442e-9e35-0e4791a8835f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:27.975215 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b6bc525-d298-442e-9e35-0e4791a8835f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:28.106821 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3b6bc525-d298-442e-9e35-0e4791a8835f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:28.114154 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3b6bc525-d298-442e-9e35-0e4791a8835f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1265 microversion: 2.1 time: 0.152339 Jul 27 07:53:28.114738 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 268/525] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:27 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:53:29.001142 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-78d36cd2-bd7d-440e-abdc-671791539e1c tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:29.001761 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-78d36cd2-bd7d-440e-abdc-671791539e1c tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:29.008896 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-78d36cd2-bd7d-440e-abdc-671791539e1c tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:29.009838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-78d36cd2-bd7d-440e-abdc-671791539e1c tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:29.010648 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-78d36cd2-bd7d-440e-abdc-671791539e1c tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:29.011119 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-78d36cd2-bd7d-440e-abdc-671791539e1c tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:29.135955 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3d936c96-3dc4-4a64-9aeb-1f6c73dd79f2 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:29.136549 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3d936c96-3dc4-4a64-9aeb-1f6c73dd79f2 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:29.142999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3d936c96-3dc4-4a64-9aeb-1f6c73dd79f2 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:29.143704 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3d936c96-3dc4-4a64-9aeb-1f6c73dd79f2 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:29.144228 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3d936c96-3dc4-4a64-9aeb-1f6c73dd79f2 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:29.144666 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3d936c96-3dc4-4a64-9aeb-1f6c73dd79f2 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:29.154587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-78d36cd2-bd7d-440e-abdc-671791539e1c tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:29.162277 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-78d36cd2-bd7d-440e-abdc-671791539e1c tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 200 len: 1499 microversion: 2.1 time: 0.165003 Jul 27 07:53:29.163132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 258/526] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:28 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 1499 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:29.513551 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3d936c96-3dc4-4a64-9aeb-1f6c73dd79f2 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:29.521238 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3d936c96-3dc4-4a64-9aeb-1f6c73dd79f2 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1265 microversion: 2.1 time: 0.389621 Jul 27 07:53:29.521804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 269/527] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:29 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1265 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:53:29.671356 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-da74c45d-185a-4760-9171-6dbb08600a8f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b23a632d-7382-4c14-ab62-17c1ea042e0e"}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:53:29.673745 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-da74c45d-185a-4760-9171-6dbb08600a8f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:29.679729 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-da74c45d-185a-4760-9171-6dbb08600a8f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:29.680172 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-da74c45d-185a-4760-9171-6dbb08600a8f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:29.680936 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-da74c45d-185a-4760-9171-6dbb08600a8f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:29.681856 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-da74c45d-185a-4760-9171-6dbb08600a8f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:29.810712 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-885f004b-7a2e-4a43-8b10-a5beccb0fbaf tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:29.811266 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-885f004b-7a2e-4a43-8b10-a5beccb0fbaf tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:29.814019 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:29.815122 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=8 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:29.815822 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:29.820277 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=8 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:29.822603 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-885f004b-7a2e-4a43-8b10-a5beccb0fbaf tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:29.823261 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-885f004b-7a2e-4a43-8b10-a5beccb0fbaf tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:29.824125 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-885f004b-7a2e-4a43-8b10-a5beccb0fbaf tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:29.824565 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-885f004b-7a2e-4a43-8b10-a5beccb0fbaf tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:29.852818 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-885f004b-7a2e-4a43-8b10-a5beccb0fbaf tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 07:53:29.937460 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-885f004b-7a2e-4a43-8b10-a5beccb0fbaf tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 204 len: 0 microversion: 2.1 time: 0.130827 Jul 27 07:53:29.938039 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 270/528] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 07:53:29 2022] DELETE /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 07:53:29.947414 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e122830a-55ed-4b81-83ed-0571392fc111 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:29.947804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e122830a-55ed-4b81-83ed-0571392fc111 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:29.954275 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e122830a-55ed-4b81-83ed-0571392fc111 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:29.954723 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e122830a-55ed-4b81-83ed-0571392fc111 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:29.955876 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e122830a-55ed-4b81-83ed-0571392fc111 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:29.956347 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e122830a-55ed-4b81-83ed-0571392fc111 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:29.972032 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-da74c45d-185a-4760-9171-6dbb08600a8f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "POST /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304302 Jul 27 07:53:29.979376 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 259/529] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Jul 27 07:53:29 2022] POST /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:53:30.091417 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e122830a-55ed-4b81-83ed-0571392fc111 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:30.099148 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e122830a-55ed-4b81-83ed-0571392fc111 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 200 len: 1505 microversion: 2.1 time: 0.156641 Jul 27 07:53:30.099720 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 271/530] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:29 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:53:30.543630 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d0e96af5-96a7-4244-ac42-1d5aa5d0dd0b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:30.544317 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d0e96af5-96a7-4244-ac42-1d5aa5d0dd0b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:30.550487 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d0e96af5-96a7-4244-ac42-1d5aa5d0dd0b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:30.550959 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d0e96af5-96a7-4244-ac42-1d5aa5d0dd0b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:30.551717 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d0e96af5-96a7-4244-ac42-1d5aa5d0dd0b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:30.552147 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d0e96af5-96a7-4244-ac42-1d5aa5d0dd0b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:30.682420 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d0e96af5-96a7-4244-ac42-1d5aa5d0dd0b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:30.689752 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d0e96af5-96a7-4244-ac42-1d5aa5d0dd0b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1265 microversion: 2.1 time: 0.151280 Jul 27 07:53:30.690314 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 260/531] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:30 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:31.121116 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3341863e-bcaf-4484-a161-2d4dd7ce419c tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:31.121719 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3341863e-bcaf-4484-a161-2d4dd7ce419c tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:31.128234 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3341863e-bcaf-4484-a161-2d4dd7ce419c tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:31.128676 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3341863e-bcaf-4484-a161-2d4dd7ce419c tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:31.129427 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3341863e-bcaf-4484-a161-2d4dd7ce419c tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:31.129854 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3341863e-bcaf-4484-a161-2d4dd7ce419c tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:31.262624 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3341863e-bcaf-4484-a161-2d4dd7ce419c tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:31.270249 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3341863e-bcaf-4484-a161-2d4dd7ce419c tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 200 len: 1505 microversion: 2.1 time: 0.153450 Jul 27 07:53:31.270807 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 272/532] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:31 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:31.530864 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-af75705c-2b33-4556-a3bf-b9b22fbb3a9a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:31.531372 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-af75705c-2b33-4556-a3bf-b9b22fbb3a9a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:31.537901 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-af75705c-2b33-4556-a3bf-b9b22fbb3a9a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:31.538339 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-af75705c-2b33-4556-a3bf-b9b22fbb3a9a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:31.539128 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-af75705c-2b33-4556-a3bf-b9b22fbb3a9a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:31.539558 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-af75705c-2b33-4556-a3bf-b9b22fbb3a9a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:31.563650 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-af75705c-2b33-4556-a3bf-b9b22fbb3a9a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979/ips" status: 200 len: 145 microversion: 2.1 time: 0.036628 Jul 27 07:53:31.564313 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 261/533] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Jul 27 07:53:31 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:53:31.710935 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b4f9b685-8247-4589-820f-3022cc39f33c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:31.711860 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b4f9b685-8247-4589-820f-3022cc39f33c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:31.719845 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b4f9b685-8247-4589-820f-3022cc39f33c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:31.720295 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b4f9b685-8247-4589-820f-3022cc39f33c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:31.721072 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b4f9b685-8247-4589-820f-3022cc39f33c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:31.721504 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b4f9b685-8247-4589-820f-3022cc39f33c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:31.740561 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:31.860144 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b4f9b685-8247-4589-820f-3022cc39f33c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:31.868996 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b4f9b685-8247-4589-820f-3022cc39f33c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1265 microversion: 2.1 time: 0.162132 Jul 27 07:53:31.870599 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 273/534] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:31 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:32.292274 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-3c436b57-d01b-4efe-8bca-a345934bada4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:32.292885 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-3c436b57-d01b-4efe-8bca-a345934bada4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:32.299425 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3c436b57-d01b-4efe-8bca-a345934bada4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:32.299872 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3c436b57-d01b-4efe-8bca-a345934bada4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:32.300633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3c436b57-d01b-4efe-8bca-a345934bada4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:32.301067 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3c436b57-d01b-4efe-8bca-a345934bada4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:32.440863 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3c436b57-d01b-4efe-8bca-a345934bada4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:32.449606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-3c436b57-d01b-4efe-8bca-a345934bada4 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 200 len: 1505 microversion: 2.1 time: 0.161929 Jul 27 07:53:32.450170 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 262/535] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:32 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:32.889860 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c42da56f-092e-4cfa-b330-8105ca3f84b8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:32.890492 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c42da56f-092e-4cfa-b330-8105ca3f84b8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:32.897033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c42da56f-092e-4cfa-b330-8105ca3f84b8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:32.897484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c42da56f-092e-4cfa-b330-8105ca3f84b8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:32.898245 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c42da56f-092e-4cfa-b330-8105ca3f84b8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:32.898677 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c42da56f-092e-4cfa-b330-8105ca3f84b8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:33.032008 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c42da56f-092e-4cfa-b330-8105ca3f84b8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:33.044914 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c42da56f-092e-4cfa-b330-8105ca3f84b8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1265 microversion: 2.1 time: 0.158903 Jul 27 07:53:33.045479 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 274/536] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:32 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:33.529617 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e7efc9cc-7ec4-44bf-aa9b-54f6c613c035 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:33.530322 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e7efc9cc-7ec4-44bf-aa9b-54f6c613c035 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:33.536918 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e7efc9cc-7ec4-44bf-aa9b-54f6c613c035 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:33.537431 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e7efc9cc-7ec4-44bf-aa9b-54f6c613c035 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:33.538203 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e7efc9cc-7ec4-44bf-aa9b-54f6c613c035 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:33.538576 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e7efc9cc-7ec4-44bf-aa9b-54f6c613c035 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:33.669874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e7efc9cc-7ec4-44bf-aa9b-54f6c613c035 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:33.677373 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e7efc9cc-7ec4-44bf-aa9b-54f6c613c035 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 200 len: 1505 microversion: 2.1 time: 0.152208 Jul 27 07:53:33.677930 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 263/537] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:33 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:34.065550 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1feb0ab3-85bb-400d-bada-7afa003c796b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:34.066151 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1feb0ab3-85bb-400d-bada-7afa003c796b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:34.073477 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1feb0ab3-85bb-400d-bada-7afa003c796b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:34.073915 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1feb0ab3-85bb-400d-bada-7afa003c796b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:34.074682 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1feb0ab3-85bb-400d-bada-7afa003c796b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:34.075147 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1feb0ab3-85bb-400d-bada-7afa003c796b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:34.219564 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1feb0ab3-85bb-400d-bada-7afa003c796b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:34.228592 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1feb0ab3-85bb-400d-bada-7afa003c796b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1265 microversion: 2.1 time: 0.166301 Jul 27 07:53:34.229173 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 275/538] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:34 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:34.584066 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-6ca4457c-bc80-4cca-be35-61c3bd6b9bcb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be45c7b0-304f-4fbb-a54b-cc9cadef822c"}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:53:34.587149 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-6ca4457c-bc80-4cca-be35-61c3bd6b9bcb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:34.594671 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6ca4457c-bc80-4cca-be35-61c3bd6b9bcb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:34.595248 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6ca4457c-bc80-4cca-be35-61c3bd6b9bcb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:34.596038 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6ca4457c-bc80-4cca-be35-61c3bd6b9bcb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:34.596523 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6ca4457c-bc80-4cca-be35-61c3bd6b9bcb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:34.699251 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-aa3c6925-a245-41f2-941b-ce499abeaea1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:34.699866 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-aa3c6925-a245-41f2-941b-ce499abeaea1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:34.707169 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aa3c6925-a245-41f2-941b-ce499abeaea1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:34.707810 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aa3c6925-a245-41f2-941b-ce499abeaea1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:34.708605 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aa3c6925-a245-41f2-941b-ce499abeaea1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:34.709430 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aa3c6925-a245-41f2-941b-ce499abeaea1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:34.868712 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-aa3c6925-a245-41f2-941b-ce499abeaea1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:34.878108 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-aa3c6925-a245-41f2-941b-ce499abeaea1 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 200 len: 1505 microversion: 2.1 time: 0.182630 Jul 27 07:53:34.879464 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 276/539] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:34 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:53:34.965139 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-6ca4457c-bc80-4cca-be35-61c3bd6b9bcb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "POST /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384636 Jul 27 07:53:34.966126 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 264/540] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Jul 27 07:53:34 2022] POST /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:53:35.203687 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-78b433f3-ba00-405e-b1d5-e32d5e8e3a42 req-8ff05650-13dd-47e4-80a9-045a4e98ff51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ccad593-afaa-4045-8e25-b0f0a17368e4", "name": "network-vif-deleted", "tag": "aea5cf6d-44db-464b-a6c7-6f193f601693"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:53:35.214315 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-78b433f3-ba00-405e-b1d5-e32d5e8e3a42 req-8ff05650-13dd-47e4-80a9-045a4e98ff51 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:35.214993 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-78b433f3-ba00-405e-b1d5-e32d5e8e3a42 req-8ff05650-13dd-47e4-80a9-045a4e98ff51 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:35.232846 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-78b433f3-ba00-405e-b1d5-e32d5e8e3a42 req-8ff05650-13dd-47e4-80a9-045a4e98ff51 service nova] Creating event network-vif-deleted:aea5cf6d-44db-464b-a6c7-6f193f601693 for instance 1ccad593-afaa-4045-8e25-b0f0a17368e4 on hv-cinder-82549 Jul 27 07:53:35.238051 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-78b433f3-ba00-405e-b1d5-e32d5e8e3a42 req-8ff05650-13dd-47e4-80a9-045a4e98ff51 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037952 Jul 27 07:53:35.238983 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 277/541] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:53:35.251738 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2f7dc6af-311b-488a-a897-64de679ba119 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:35.252728 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2f7dc6af-311b-488a-a897-64de679ba119 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:35.260406 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2f7dc6af-311b-488a-a897-64de679ba119 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:35.260924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2f7dc6af-311b-488a-a897-64de679ba119 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:35.261768 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2f7dc6af-311b-488a-a897-64de679ba119 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:35.262270 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2f7dc6af-311b-488a-a897-64de679ba119 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:35.424609 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2f7dc6af-311b-488a-a897-64de679ba119 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:35.433981 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2f7dc6af-311b-488a-a897-64de679ba119 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1265 microversion: 2.1 time: 0.186614 Jul 27 07:53:35.434639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 265/542] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:35 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:35.901313 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c4e14f63-b84e-4945-b463-e1d9dc7eabc0 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:35.902375 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c4e14f63-b84e-4945-b463-e1d9dc7eabc0 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:35.908835 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c4e14f63-b84e-4945-b463-e1d9dc7eabc0 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:35.909281 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c4e14f63-b84e-4945-b463-e1d9dc7eabc0 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:35.910054 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c4e14f63-b84e-4945-b463-e1d9dc7eabc0 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:35.910495 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c4e14f63-b84e-4945-b463-e1d9dc7eabc0 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:35.940708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c4e14f63-b84e-4945-b463-e1d9dc7eabc0 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:35.941182 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c4e14f63-b84e-4945-b463-e1d9dc7eabc0 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:35.941629 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-c4e14f63-b84e-4945-b463-e1d9dc7eabc0 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lazy-loading 'fault' on Instance uuid 1ccad593-afaa-4045-8e25-b0f0a17368e4 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:53:35.986867 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c4e14f63-b84e-4945-b463-e1d9dc7eabc0 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91dd24f48d5843fb973b5a2ce726227f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f907cffd2047aea54235f1c750f234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:35.994408 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c4e14f63-b84e-4945-b463-e1d9dc7eabc0 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 200 len: 1304 microversion: 2.1 time: 0.098439 Jul 27 07:53:35.995234 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 278/543] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:35 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:36.456395 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ebf49daa-cc98-4fb5-b148-5bebefb5557d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:36.457005 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ebf49daa-cc98-4fb5-b148-5bebefb5557d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:36.464076 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ebf49daa-cc98-4fb5-b148-5bebefb5557d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:36.464525 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ebf49daa-cc98-4fb5-b148-5bebefb5557d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:36.465314 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ebf49daa-cc98-4fb5-b148-5bebefb5557d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:36.465746 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ebf49daa-cc98-4fb5-b148-5bebefb5557d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:36.596508 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ebf49daa-cc98-4fb5-b148-5bebefb5557d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:36.604214 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ebf49daa-cc98-4fb5-b148-5bebefb5557d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1265 microversion: 2.1 time: 0.151628 Jul 27 07:53:36.604722 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 266/544] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:36 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:37.016836 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1884b55e-f1be-428d-807c-80b732fec402 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:37.017381 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1884b55e-f1be-428d-807c-80b732fec402 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] [instance: 1ccad593-afaa-4045-8e25-b0f0a17368e4] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:37.023894 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1884b55e-f1be-428d-807c-80b732fec402 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:37.024334 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1884b55e-f1be-428d-807c-80b732fec402 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:37.025118 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1884b55e-f1be-428d-807c-80b732fec402 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:37.025551 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1884b55e-f1be-428d-807c-80b732fec402 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:37.039433 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-1884b55e-f1be-428d-807c-80b732fec402 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] HTTP exception thrown: Instance 1ccad593-afaa-4045-8e25-b0f0a17368e4 could not be found. Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1884b55e-f1be-428d-807c-80b732fec402 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Request method failure captured: Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 HTTP/1.1 Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O7PQM9PdnjoSIdqvgI2FNdKMynIJ_LHwAvmHu4CCgcZsIPW4KxTp1sdnocIkAtfrQ1DOnOvd3K2HzIhLNOKUqcE8hDIDOQttfbBAxQskfyFD_Eb3QSjXAjBHzJ1Pi_IVOXd9j4n0-7tddnsTnCmHMkBy8D-MIf7ECiSciwGt3Fu5Lo Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: c2f907cffd2047aea54235f1c750f234 Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesActionsTest-869344110 Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 07:53:37.041062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 07:53:37.042674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c2f907cffd2047aea54235f1c750f234"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c2f907cffd2047aea54235f1c750f234"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c2f907cffd2047aea54235f1c750f234"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c2f907cffd2047aea54235f1c750f234"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:53:37.042674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesActionsTest-869344110 Jul 27 07:53:37.042674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: c2f907cffd2047aea54235f1c750f234 Jul 27 07:53:37.042674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesActionsTest-869344110 Jul 27 07:53:37.042674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesActionsTest-869344110-project Jul 27 07:53:37.042674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 07:53:37.042674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 07:53:37.042674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: 91dd24f48d5843fb973b5a2ce726227f Jul 27 07:53:37.042674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesActionsTest-869344110-project Jul 27 07:53:37.042674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 07:53:37.042674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance 1ccad593-afaa-4045-8e25-b0f0a17368e4 could not be found. Jul 27 07:53:37.042674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': '1ccad593-afaa-4045-8e25-b0f0a17368e4'} Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ccad593-afaa-4045-8e25-b0f0a17368e4 could not be found. Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:53:37.043689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:53:37.045480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:53:37.045480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 07:53:37.045480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 07:53:37.045480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 07:53:37.045480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 07:53:37.045480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 07:53:37.045480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:53:37.045480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ccad593-afaa-4045-8e25-b0f0a17368e4 could not be found. Jul 27 07:53:37.045480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:53:37.045480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:53:37.045480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:53:37.045480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:53:37.045480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:53:37.045480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:53:37.045480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:53:37.045480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:53:37.045480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ccad593-afaa-4045-8e25-b0f0a17368e4 could not be found. Jul 27 07:53:37.045480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:53:37.047238 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1884b55e-f1be-428d-807c-80b732fec402 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] Returning 404 to user: Instance 1ccad593-afaa-4045-8e25-b0f0a17368e4 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:53:37.047238 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1884b55e-f1be-428d-807c-80b732fec402 tempest-VolumesActionsTest-869344110 tempest-VolumesActionsTest-869344110-project] 10.222.0.18 "GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4" status: 404 len: 111 microversion: 2.1 time: 0.030432 Jul 27 07:53:37.047238 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 279/545] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:37 2022] GET /compute/v2.1/servers/1ccad593-afaa-4045-8e25-b0f0a17368e4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 07:53:37.426439 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-2b614e49-d3d6-44bc-8317-888dc9326b1b req-ec44408a-a263-44e2-9dc8-172201a4327f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d599a647-2c57-4095-8875-7eb9ac54150f", "name": "network-vif-plugged", "status": "completed", "tag": "0e2e33bc-ba25-4cd3-9bd5-b56a3d33a66e"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:53:37.438142 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-2b614e49-d3d6-44bc-8317-888dc9326b1b req-ec44408a-a263-44e2-9dc8-172201a4327f service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:37.438593 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-2b614e49-d3d6-44bc-8317-888dc9326b1b req-ec44408a-a263-44e2-9dc8-172201a4327f service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:37.454807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-2b614e49-d3d6-44bc-8317-888dc9326b1b req-ec44408a-a263-44e2-9dc8-172201a4327f service nova] Creating event network-vif-plugged:0e2e33bc-ba25-4cd3-9bd5-b56a3d33a66e for instance d599a647-2c57-4095-8875-7eb9ac54150f on hv-cinder-82549 Jul 27 07:53:37.460069 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-2b614e49-d3d6-44bc-8317-888dc9326b1b req-ec44408a-a263-44e2-9dc8-172201a4327f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037145 Jul 27 07:53:37.460721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 267/546] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:53:37.624592 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3eeb0f49-f2db-491d-b09a-d2026521d16f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:37.625206 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3eeb0f49-f2db-491d-b09a-d2026521d16f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:37.631758 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3eeb0f49-f2db-491d-b09a-d2026521d16f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:37.632207 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3eeb0f49-f2db-491d-b09a-d2026521d16f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:37.632986 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3eeb0f49-f2db-491d-b09a-d2026521d16f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:37.633424 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3eeb0f49-f2db-491d-b09a-d2026521d16f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:37.781408 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3eeb0f49-f2db-491d-b09a-d2026521d16f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:37.789210 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3eeb0f49-f2db-491d-b09a-d2026521d16f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1265 microversion: 2.1 time: 0.168492 Jul 27 07:53:37.789780 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 280/547] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:37 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:38.812200 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b015886f-c270-4478-8a7c-abc8b0eda686 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:38.812902 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b015886f-c270-4478-8a7c-abc8b0eda686 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:38.819320 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b015886f-c270-4478-8a7c-abc8b0eda686 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:38.819783 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b015886f-c270-4478-8a7c-abc8b0eda686 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:38.820572 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b015886f-c270-4478-8a7c-abc8b0eda686 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:38.821007 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b015886f-c270-4478-8a7c-abc8b0eda686 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:38.956383 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b015886f-c270-4478-8a7c-abc8b0eda686 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:38.963843 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b015886f-c270-4478-8a7c-abc8b0eda686 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1265 microversion: 2.1 time: 0.157870 Jul 27 07:53:38.964406 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 268/548] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:38 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:39.987809 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e8721ccd-2979-42a5-8698-a9e79293906d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:39.988799 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e8721ccd-2979-42a5-8698-a9e79293906d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:39.997496 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e8721ccd-2979-42a5-8698-a9e79293906d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:39.997947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e8721ccd-2979-42a5-8698-a9e79293906d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:39.998723 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e8721ccd-2979-42a5-8698-a9e79293906d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:39.999203 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e8721ccd-2979-42a5-8698-a9e79293906d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:40.127809 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e8721ccd-2979-42a5-8698-a9e79293906d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:40.135798 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e8721ccd-2979-42a5-8698-a9e79293906d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1265 microversion: 2.1 time: 0.155073 Jul 27 07:53:40.136354 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 281/549] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:39 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:41.096123 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f85e7d6e-018a-491b-ab5b-ea8e6e8c8cb4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:41.096700 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f85e7d6e-018a-491b-ab5b-ea8e6e8c8cb4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:41.103550 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f85e7d6e-018a-491b-ab5b-ea8e6e8c8cb4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:41.103998 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f85e7d6e-018a-491b-ab5b-ea8e6e8c8cb4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:41.104763 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f85e7d6e-018a-491b-ab5b-ea8e6e8c8cb4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:41.105202 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f85e7d6e-018a-491b-ab5b-ea8e6e8c8cb4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:41.128899 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f85e7d6e-018a-491b-ab5b-ea8e6e8c8cb4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/ips" status: 200 len: 153 microversion: 2.20 time: 0.036647 Jul 27 07:53:41.129465 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 269/550] 10.222.0.18 () {60 vars in 1289 bytes} [Wed Jul 27 07:53:41 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 07:53:41.156713 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-dd10047e-3a57-4d5f-8d69-ad4ad74a5ee1 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:41.157330 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-dd10047e-3a57-4d5f-8d69-ad4ad74a5ee1 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:41.163865 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dd10047e-3a57-4d5f-8d69-ad4ad74a5ee1 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:41.164319 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dd10047e-3a57-4d5f-8d69-ad4ad74a5ee1 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:41.165127 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dd10047e-3a57-4d5f-8d69-ad4ad74a5ee1 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:41.165566 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dd10047e-3a57-4d5f-8d69-ad4ad74a5ee1 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:41.313199 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-dd10047e-3a57-4d5f-8d69-ad4ad74a5ee1 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:41.320967 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-dd10047e-3a57-4d5f-8d69-ad4ad74a5ee1 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1265 microversion: 2.1 time: 0.168046 Jul 27 07:53:41.322067 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 282/551] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:41 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:42.342546 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-514d9976-833e-4f55-8848-7742e8c4d0f9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:42.343213 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-514d9976-833e-4f55-8848-7742e8c4d0f9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:42.350170 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-514d9976-833e-4f55-8848-7742e8c4d0f9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:42.350623 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-514d9976-833e-4f55-8848-7742e8c4d0f9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:42.351422 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-514d9976-833e-4f55-8848-7742e8c4d0f9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:42.351862 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-514d9976-833e-4f55-8848-7742e8c4d0f9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:42.367962 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:42.491873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-514d9976-833e-4f55-8848-7742e8c4d0f9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:42.499907 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-514d9976-833e-4f55-8848-7742e8c4d0f9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1265 microversion: 2.1 time: 0.161195 Jul 27 07:53:42.500454 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 270/552] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:42 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:43.520341 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-48511e22-644a-4b55-aab8-08b66e88d164 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:43.520984 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-48511e22-644a-4b55-aab8-08b66e88d164 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:43.528321 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-48511e22-644a-4b55-aab8-08b66e88d164 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:43.528777 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-48511e22-644a-4b55-aab8-08b66e88d164 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:43.529584 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-48511e22-644a-4b55-aab8-08b66e88d164 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:43.530054 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-48511e22-644a-4b55-aab8-08b66e88d164 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:43.661326 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-48511e22-644a-4b55-aab8-08b66e88d164 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:43.669061 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-48511e22-644a-4b55-aab8-08b66e88d164 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1265 microversion: 2.1 time: 0.152512 Jul 27 07:53:43.669627 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 283/553] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:43 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:44.691688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e754cead-83e5-4ba2-ad4e-068bcb792a0b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:44.693275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e754cead-83e5-4ba2-ad4e-068bcb792a0b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:44.699948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e754cead-83e5-4ba2-ad4e-068bcb792a0b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:44.700405 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e754cead-83e5-4ba2-ad4e-068bcb792a0b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:44.701173 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e754cead-83e5-4ba2-ad4e-068bcb792a0b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:44.701611 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e754cead-83e5-4ba2-ad4e-068bcb792a0b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:44.838824 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e754cead-83e5-4ba2-ad4e-068bcb792a0b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:44.846841 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e754cead-83e5-4ba2-ad4e-068bcb792a0b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1265 microversion: 2.1 time: 0.158965 Jul 27 07:53:44.847731 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 271/554] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:44 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:45.870118 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-cad983f1-44a7-4c26-b76c-7f10f39ecfde tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:45.871845 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-cad983f1-44a7-4c26-b76c-7f10f39ecfde tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:45.881189 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cad983f1-44a7-4c26-b76c-7f10f39ecfde tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:45.881810 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cad983f1-44a7-4c26-b76c-7f10f39ecfde tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:45.882914 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cad983f1-44a7-4c26-b76c-7f10f39ecfde tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:45.884242 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cad983f1-44a7-4c26-b76c-7f10f39ecfde tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:46.060405 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-cad983f1-44a7-4c26-b76c-7f10f39ecfde tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:46.069370 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-cad983f1-44a7-4c26-b76c-7f10f39ecfde tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1451 microversion: 2.1 time: 0.205171 Jul 27 07:53:46.083328 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 284/555] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:45 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1451 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:46.091435 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-dae820a9-fdf6-465c-b2a9-50840c7821b8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:46.092253 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-dae820a9-fdf6-465c-b2a9-50840c7821b8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:46.099265 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dae820a9-fdf6-465c-b2a9-50840c7821b8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:46.099939 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dae820a9-fdf6-465c-b2a9-50840c7821b8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:46.100877 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dae820a9-fdf6-465c-b2a9-50840c7821b8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:46.101525 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dae820a9-fdf6-465c-b2a9-50840c7821b8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:46.276245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-dae820a9-fdf6-465c-b2a9-50840c7821b8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:46.286974 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-dae820a9-fdf6-465c-b2a9-50840c7821b8 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1451 microversion: 2.1 time: 0.199095 Jul 27 07:53:46.288073 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 272/556] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:46 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1451 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:53:46.339882 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-784b0be2-406d-4c5d-816a-dd1c79c7ed26 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:53:46.340413 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-784b0be2-406d-4c5d-816a-dd1c79c7ed26 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:46.353556 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-784b0be2-406d-4c5d-816a-dd1c79c7ed26 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:46.353989 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-784b0be2-406d-4c5d-816a-dd1c79c7ed26 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:46.354765 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-784b0be2-406d-4c5d-816a-dd1c79c7ed26 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:46.355346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-784b0be2-406d-4c5d-816a-dd1c79c7ed26 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:46.392479 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-784b0be2-406d-4c5d-816a-dd1c79c7ed26 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lazy-loading 'flavor' on Instance uuid 880126db-79f5-4c11-a0b5-85a612a1662a {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:53:46.629388 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-784b0be2-406d-4c5d-816a-dd1c79c7ed26 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "POST /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/action" status: 202 len: 0 microversion: 2.20 time: 0.292501 Jul 27 07:53:46.640370 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-87b34245-d9e5-4e98-b479-36a54713d329 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:46.641848 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-87b34245-d9e5-4e98-b479-36a54713d329 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:46.647237 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 285/557] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Jul 27 07:53:46 2022] POST /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 07:53:46.650409 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-87b34245-d9e5-4e98-b479-36a54713d329 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:46.651162 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-87b34245-d9e5-4e98-b479-36a54713d329 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:46.652145 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-87b34245-d9e5-4e98-b479-36a54713d329 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:46.652782 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-87b34245-d9e5-4e98-b479-36a54713d329 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:46.855575 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-87b34245-d9e5-4e98-b479-36a54713d329 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:46.880548 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-87b34245-d9e5-4e98-b479-36a54713d329 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:46.888312 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-87b34245-d9e5-4e98-b479-36a54713d329 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:46.890757 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-87b34245-d9e5-4e98-b479-36a54713d329 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.255558 Jul 27 07:53:46.892461 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 273/558] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:53:46 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:53:47.916168 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f95dc4f5-e2d8-407a-8719-4e4073c8bf1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:47.917166 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f95dc4f5-e2d8-407a-8719-4e4073c8bf1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:47.925246 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f95dc4f5-e2d8-407a-8719-4e4073c8bf1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:47.925691 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f95dc4f5-e2d8-407a-8719-4e4073c8bf1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:47.926453 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f95dc4f5-e2d8-407a-8719-4e4073c8bf1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:47.926913 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f95dc4f5-e2d8-407a-8719-4e4073c8bf1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:48.179310 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f95dc4f5-e2d8-407a-8719-4e4073c8bf1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:48.189310 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f95dc4f5-e2d8-407a-8719-4e4073c8bf1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:48.191213 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f95dc4f5-e2d8-407a-8719-4e4073c8bf1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:48.211974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f95dc4f5-e2d8-407a-8719-4e4073c8bf1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.299332 Jul 27 07:53:48.213610 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 286/559] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:53:47 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:53:48.326779 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c5fac9e8-9d40-4d4c-a087-efa044c6e66b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Action: 'create', calling method: .version_select at 0x7f19fe51cd30>, body: {"keypair": {"name": "tempest-keypair-896920266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0M6VPfDUNsmPwdgmw0yNap3sJF200FU22M8X208uOkKHcPebGJh+E20nFtl5UqZBA8FmEzuo1Idqh3pbrBmlVh7U/8q6JkxTdkTiqd6vd5FWiEGzx9DxY2k2Q1dGdSbQ=="}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:53:48.344520 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-c5fac9e8-9d40-4d4c-a087-efa044c6e66b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Getting quotas for project 1cabcb825ebe4430a7ffa759d5e53d2f. Resources: {'key_pairs'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:53:48.349862 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-c5fac9e8-9d40-4d4c-a087-efa044c6e66b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Getting quotas for user df8fb928aa42413b9d03e83f46dd48bc and project 1cabcb825ebe4430a7ffa759d5e53d2f. Resources: {'key_pairs'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:53:48.381829 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c5fac9e8-9d40-4d4c-a087-efa044c6e66b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060852 Jul 27 07:53:48.382602 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 274/560] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Jul 27 07:53:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:53:48.634246 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-48f9d64d-9a22-4097-b7f3-f916ac9b5dae req-245752e2-cde1-4e11-bdf6-6bea9de9d628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d599a647-2c57-4095-8875-7eb9ac54150f", "tag": "0e2e33bc-ba25-4cd3-9bd5-b56a3d33a66e"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:53:48.652655 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-48f9d64d-9a22-4097-b7f3-f916ac9b5dae req-245752e2-cde1-4e11-bdf6-6bea9de9d628 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:48.653380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-48f9d64d-9a22-4097-b7f3-f916ac9b5dae req-245752e2-cde1-4e11-bdf6-6bea9de9d628 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:48.672251 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-48f9d64d-9a22-4097-b7f3-f916ac9b5dae req-245752e2-cde1-4e11-bdf6-6bea9de9d628 service nova] Creating event network-changed:0e2e33bc-ba25-4cd3-9bd5-b56a3d33a66e for instance d599a647-2c57-4095-8875-7eb9ac54150f on hv-cinder-82549 Jul 27 07:53:48.684753 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-48f9d64d-9a22-4097-b7f3-f916ac9b5dae req-245752e2-cde1-4e11-bdf6-6bea9de9d628 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053178 Jul 27 07:53:48.692302 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 287/561] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:53:49.240639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-02afcfd1-7f3d-47ac-89b4-122a05f07fea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:49.241873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-02afcfd1-7f3d-47ac-89b4-122a05f07fea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:49.271907 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-02afcfd1-7f3d-47ac-89b4-122a05f07fea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:49.272858 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-02afcfd1-7f3d-47ac-89b4-122a05f07fea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:49.283932 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-02afcfd1-7f3d-47ac-89b4-122a05f07fea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:49.284777 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-02afcfd1-7f3d-47ac-89b4-122a05f07fea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:49.592598 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-02afcfd1-7f3d-47ac-89b4-122a05f07fea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:49.622846 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-02afcfd1-7f3d-47ac-89b4-122a05f07fea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:49.633158 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-02afcfd1-7f3d-47ac-89b4-122a05f07fea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:49.635385 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-02afcfd1-7f3d-47ac-89b4-122a05f07fea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.398884 Jul 27 07:53:49.640510 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 275/562] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:53:49 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:53:50.279573 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0c29ef10-471a-4aef-8c0b-b5c52ee6dd1d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2052930157", "imageRef": "646bfb5d-ef25-404a-a432-35d4209840fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2524cead-0094-4b3d-89eb-61da848d7e54"}], "security_groups": [{"name": "tempest-securitygroup--992872766"}], "key_name": "tempest-keypair-896920266", "user_data": "}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:53:50.421053 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.network.neutron [None req-0c29ef10-471a-4aef-8c0b-b5c52ee6dd1d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] validate_networks() for [('2524cead-0094-4b3d-89eb-61da848d7e54', None, None, None, None, None)] {{(pid=117780) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:53:50.662938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d29a23d7-ee5f-45c7-b5cd-56c6cc080e6a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:50.663474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d29a23d7-ee5f-45c7-b5cd-56c6cc080e6a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:50.670262 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d29a23d7-ee5f-45c7-b5cd-56c6cc080e6a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:50.671018 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d29a23d7-ee5f-45c7-b5cd-56c6cc080e6a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:50.672043 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d29a23d7-ee5f-45c7-b5cd-56c6cc080e6a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:50.672686 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d29a23d7-ee5f-45c7-b5cd-56c6cc080e6a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:50.834035 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d29a23d7-ee5f-45c7-b5cd-56c6cc080e6a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:50.846939 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d29a23d7-ee5f-45c7-b5cd-56c6cc080e6a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:50.849893 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d29a23d7-ee5f-45c7-b5cd-56c6cc080e6a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:50.852935 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d29a23d7-ee5f-45c7-b5cd-56c6cc080e6a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.193297 Jul 27 07:53:50.854023 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 276/563] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:53:50 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:53:51.206761 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-0c29ef10-471a-4aef-8c0b-b5c52ee6dd1d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Flavor limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:53:51.208120 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-0c29ef10-471a-4aef-8c0b-b5c52ee6dd1d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Image limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:53:51.209836 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-0c29ef10-471a-4aef-8c0b-b5c52ee6dd1d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Flavor pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:53:51.211391 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-0c29ef10-471a-4aef-8c0b-b5c52ee6dd1d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Image pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:53:51.213291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-0c29ef10-471a-4aef-8c0b-b5c52ee6dd1d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:53:51.226139 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0c29ef10-471a-4aef-8c0b-b5c52ee6dd1d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:51.226850 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0c29ef10-471a-4aef-8c0b-b5c52ee6dd1d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:51.228665 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0c29ef10-471a-4aef-8c0b-b5c52ee6dd1d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:51.229393 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0c29ef10-471a-4aef-8c0b-b5c52ee6dd1d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:51.260525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-0c29ef10-471a-4aef-8c0b-b5c52ee6dd1d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Getting quotas for project 1cabcb825ebe4430a7ffa759d5e53d2f. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:53:51.262667 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-0c29ef10-471a-4aef-8c0b-b5c52ee6dd1d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Getting quotas for user df8fb928aa42413b9d03e83f46dd48bc and project 1cabcb825ebe4430a7ffa759d5e53d2f. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:53:51.279006 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0c29ef10-471a-4aef-8c0b-b5c52ee6dd1d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Going to run 1 instances... {{(pid=117780) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:53:51.281426 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0c29ef10-471a-4aef-8c0b-b5c52ee6dd1d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='646bfb5d-ef25-404a-a432-35d4209840fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:53:51.333269 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0c29ef10-471a-4aef-8c0b-b5c52ee6dd1d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.058652 Jul 27 07:53:51.334287 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 288/564] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 07:53:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 07:53:51.345805 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-78b37dbc-9491-4c1e-9abe-8a0b5e946ca0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:51.346724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-78b37dbc-9491-4c1e-9abe-8a0b5e946ca0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:51.434399 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-78b37dbc-9491-4c1e-9abe-8a0b5e946ca0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:51.444627 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-78b37dbc-9491-4c1e-9abe-8a0b5e946ca0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 200 len: 1241 microversion: 2.1 time: 0.101309 Jul 27 07:53:51.446283 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 277/565] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:51 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:51.880085 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5d6052eb-c51a-4754-9f89-586457fa8f79 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:51.880885 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5d6052eb-c51a-4754-9f89-586457fa8f79 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:51.891481 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5d6052eb-c51a-4754-9f89-586457fa8f79 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:51.896814 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5d6052eb-c51a-4754-9f89-586457fa8f79 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:51.897820 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5d6052eb-c51a-4754-9f89-586457fa8f79 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:51.898374 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5d6052eb-c51a-4754-9f89-586457fa8f79 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:52.109820 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5d6052eb-c51a-4754-9f89-586457fa8f79 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:52.123175 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5d6052eb-c51a-4754-9f89-586457fa8f79 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:52.124835 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5d6052eb-c51a-4754-9f89-586457fa8f79 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:52.125985 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5d6052eb-c51a-4754-9f89-586457fa8f79 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.252564 Jul 27 07:53:52.126717 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 289/566] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:53:51 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:53:52.466160 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-14430696-c629-4065-9d78-62abcf313ca5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:52.466775 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-14430696-c629-4065-9d78-62abcf313ca5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:52.473727 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-14430696-c629-4065-9d78-62abcf313ca5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:52.474162 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-14430696-c629-4065-9d78-62abcf313ca5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:52.474958 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-14430696-c629-4065-9d78-62abcf313ca5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:52.475425 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-14430696-c629-4065-9d78-62abcf313ca5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:52.555865 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-14430696-c629-4065-9d78-62abcf313ca5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:52.577749 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-14430696-c629-4065-9d78-62abcf313ca5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 200 len: 1293 microversion: 2.1 time: 0.115588 Jul 27 07:53:52.579646 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 278/567] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:52 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 1293 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:53.156512 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-16aa54c5-1712-4f7f-ad3a-4cf507f2d954 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:53.157142 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-16aa54c5-1712-4f7f-ad3a-4cf507f2d954 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:53.173904 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-16aa54c5-1712-4f7f-ad3a-4cf507f2d954 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:53.174661 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-16aa54c5-1712-4f7f-ad3a-4cf507f2d954 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:53.175691 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-16aa54c5-1712-4f7f-ad3a-4cf507f2d954 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:53.176283 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-16aa54c5-1712-4f7f-ad3a-4cf507f2d954 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:53.202744 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:53.338869 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-16aa54c5-1712-4f7f-ad3a-4cf507f2d954 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:53.352300 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-16aa54c5-1712-4f7f-ad3a-4cf507f2d954 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:53.363953 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-16aa54c5-1712-4f7f-ad3a-4cf507f2d954 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:53.365639 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-16aa54c5-1712-4f7f-ad3a-4cf507f2d954 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.213320 Jul 27 07:53:53.366821 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 290/568] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:53:53 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:53:53.603019 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1796c2fa-0e89-40de-b4cd-fc418d2c1c80 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:53.603651 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1796c2fa-0e89-40de-b4cd-fc418d2c1c80 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:53.623666 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1796c2fa-0e89-40de-b4cd-fc418d2c1c80 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:53.624421 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1796c2fa-0e89-40de-b4cd-fc418d2c1c80 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:53.625204 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1796c2fa-0e89-40de-b4cd-fc418d2c1c80 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:53.625954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1796c2fa-0e89-40de-b4cd-fc418d2c1c80 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:53.821264 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1796c2fa-0e89-40de-b4cd-fc418d2c1c80 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:53.830425 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1796c2fa-0e89-40de-b4cd-fc418d2c1c80 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 200 len: 1366 microversion: 2.1 time: 0.233183 Jul 27 07:53:53.831726 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 279/569] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:53 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:54.389806 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-80cb2f44-bd1b-41ea-98d4-0d196967d5b3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:54.391701 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-80cb2f44-bd1b-41ea-98d4-0d196967d5b3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:54.401084 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-80cb2f44-bd1b-41ea-98d4-0d196967d5b3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:54.401525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-80cb2f44-bd1b-41ea-98d4-0d196967d5b3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:54.402294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-80cb2f44-bd1b-41ea-98d4-0d196967d5b3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:54.402750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-80cb2f44-bd1b-41ea-98d4-0d196967d5b3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:54.590746 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-80cb2f44-bd1b-41ea-98d4-0d196967d5b3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:54.603291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-80cb2f44-bd1b-41ea-98d4-0d196967d5b3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:54.605369 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-80cb2f44-bd1b-41ea-98d4-0d196967d5b3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:54.607041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-80cb2f44-bd1b-41ea-98d4-0d196967d5b3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.221193 Jul 27 07:53:54.623548 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 291/570] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:53:54 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:53:54.853754 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7ec34f67-c919-49ca-b0c6-3ba544b9b4e0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:54.854594 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-7ec34f67-c919-49ca-b0c6-3ba544b9b4e0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:54.869121 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7ec34f67-c919-49ca-b0c6-3ba544b9b4e0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:54.870080 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7ec34f67-c919-49ca-b0c6-3ba544b9b4e0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:54.872672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7ec34f67-c919-49ca-b0c6-3ba544b9b4e0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:54.874461 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7ec34f67-c919-49ca-b0c6-3ba544b9b4e0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:55.151440 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7ec34f67-c919-49ca-b0c6-3ba544b9b4e0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:55.161638 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7ec34f67-c919-49ca-b0c6-3ba544b9b4e0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 200 len: 1366 microversion: 2.1 time: 0.312966 Jul 27 07:53:55.164239 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 280/571] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:54 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:55.223965 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-9bb45bec-00d4-47a8-ba49-201801f0d721 req-1ac2a3a4-aff7-4585-99e3-9539a64a6409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a40e1f19-e3f4-4bc2-96d5-711703b48a28", "tag": "2179df90-07c1-42e0-9748-4b2d651be4ca"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:53:55.240257 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-9bb45bec-00d4-47a8-ba49-201801f0d721 req-1ac2a3a4-aff7-4585-99e3-9539a64a6409 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:55.240696 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-9bb45bec-00d4-47a8-ba49-201801f0d721 req-1ac2a3a4-aff7-4585-99e3-9539a64a6409 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:55.272834 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-9bb45bec-00d4-47a8-ba49-201801f0d721 req-1ac2a3a4-aff7-4585-99e3-9539a64a6409 service nova] Creating event network-changed:2179df90-07c1-42e0-9748-4b2d651be4ca for instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 on hv-cinder-82549 Jul 27 07:53:55.311672 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-9bb45bec-00d4-47a8-ba49-201801f0d721 req-1ac2a3a4-aff7-4585-99e3-9539a64a6409 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091132 Jul 27 07:53:55.312270 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 292/572] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:53:55.652042 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d303d408-d741-4048-8070-e7d6d0f393d3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:53:55.653345 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7227b80b-bc8f-494b-923c-bf2023c5f4b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:55.654053 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-7227b80b-bc8f-494b-923c-bf2023c5f4b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:55.656964 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:55.665417 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d303d408-d741-4048-8070-e7d6d0f393d3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:55.665946 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d303d408-d741-4048-8070-e7d6d0f393d3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:55.669776 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7227b80b-bc8f-494b-923c-bf2023c5f4b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:55.670347 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7227b80b-bc8f-494b-923c-bf2023c5f4b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:55.671161 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7227b80b-bc8f-494b-923c-bf2023c5f4b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:55.671592 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7227b80b-bc8f-494b-923c-bf2023c5f4b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:55.771158 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d303d408-d741-4048-8070-e7d6d0f393d3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Going to try to stop instance {{(pid=117780) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 27 07:53:55.842606 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d303d408-d741-4048-8070-e7d6d0f393d3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "POST /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979/action" status: 202 len: 0 microversion: 2.1 time: 0.194436 Jul 27 07:53:55.843529 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 293/573] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Jul 27 07:53:55 2022] POST /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 07:53:55.857143 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e19dc65b-8a22-4354-b249-75da298cadd4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:55.858130 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e19dc65b-8a22-4354-b249-75da298cadd4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:55.866574 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e19dc65b-8a22-4354-b249-75da298cadd4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:55.867409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e19dc65b-8a22-4354-b249-75da298cadd4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:55.869179 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e19dc65b-8a22-4354-b249-75da298cadd4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:55.869628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e19dc65b-8a22-4354-b249-75da298cadd4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:55.953576 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7227b80b-bc8f-494b-923c-bf2023c5f4b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:55.962979 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7227b80b-bc8f-494b-923c-bf2023c5f4b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:55.964922 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7227b80b-bc8f-494b-923c-bf2023c5f4b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:55.966285 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7227b80b-bc8f-494b-923c-bf2023c5f4b9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.338429 Jul 27 07:53:55.967926 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 281/574] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:53:55 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:53:56.059544 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e19dc65b-8a22-4354-b249-75da298cadd4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:56.072280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e19dc65b-8a22-4354-b249-75da298cadd4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1723 microversion: 2.1 time: 0.218940 Jul 27 07:53:56.073045 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 294/575] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:55 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:56.183485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b39c865a-3737-468c-afd4-470a3224741e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:56.184530 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b39c865a-3737-468c-afd4-470a3224741e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:56.194528 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b39c865a-3737-468c-afd4-470a3224741e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:56.195137 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b39c865a-3737-468c-afd4-470a3224741e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:56.196628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b39c865a-3737-468c-afd4-470a3224741e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:56.197853 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b39c865a-3737-468c-afd4-470a3224741e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:56.382571 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b39c865a-3737-468c-afd4-470a3224741e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:56.391744 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b39c865a-3737-468c-afd4-470a3224741e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 200 len: 1366 microversion: 2.1 time: 0.212375 Jul 27 07:53:56.394103 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 282/576] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:56 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:56.991111 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4149c2c9-70f9-4176-8983-413fb724e472 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:56.991905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4149c2c9-70f9-4176-8983-413fb724e472 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:56.999026 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4149c2c9-70f9-4176-8983-413fb724e472 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:56.999479 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4149c2c9-70f9-4176-8983-413fb724e472 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:57.000444 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4149c2c9-70f9-4176-8983-413fb724e472 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:57.000890 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4149c2c9-70f9-4176-8983-413fb724e472 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:57.094359 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-5eccf439-2b04-45f7-a7cb-7f3b3a74fc9c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:57.095919 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-5eccf439-2b04-45f7-a7cb-7f3b3a74fc9c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:57.104796 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5eccf439-2b04-45f7-a7cb-7f3b3a74fc9c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:57.105409 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5eccf439-2b04-45f7-a7cb-7f3b3a74fc9c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:57.106374 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5eccf439-2b04-45f7-a7cb-7f3b3a74fc9c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:57.107331 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5eccf439-2b04-45f7-a7cb-7f3b3a74fc9c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:57.160578 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4149c2c9-70f9-4176-8983-413fb724e472 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:57.169719 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4149c2c9-70f9-4176-8983-413fb724e472 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:57.171360 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4149c2c9-70f9-4176-8983-413fb724e472 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:57.172618 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4149c2c9-70f9-4176-8983-413fb724e472 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.185579 Jul 27 07:53:57.181150 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 295/577] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:53:56 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:53:57.292684 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-5eccf439-2b04-45f7-a7cb-7f3b3a74fc9c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:57.301214 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-5eccf439-2b04-45f7-a7cb-7f3b3a74fc9c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1723 microversion: 2.1 time: 0.211926 Jul 27 07:53:57.302114 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 283/578] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:57 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:57.413958 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-38530304-5659-424d-821c-447e36208207 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:57.414554 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-38530304-5659-424d-821c-447e36208207 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:57.427466 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-38530304-5659-424d-821c-447e36208207 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:57.428234 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-38530304-5659-424d-821c-447e36208207 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:57.429257 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-38530304-5659-424d-821c-447e36208207 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:57.429893 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-38530304-5659-424d-821c-447e36208207 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:57.607657 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-38530304-5659-424d-821c-447e36208207 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:57.620453 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-38530304-5659-424d-821c-447e36208207 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 200 len: 1366 microversion: 2.1 time: 0.210288 Jul 27 07:53:57.621729 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 296/579] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:57 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:58.200209 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-323b55be-d954-4a01-832e-36f50816fb84 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:58.201119 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-323b55be-d954-4a01-832e-36f50816fb84 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:58.208130 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-323b55be-d954-4a01-832e-36f50816fb84 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:58.208702 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-323b55be-d954-4a01-832e-36f50816fb84 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:58.209605 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-323b55be-d954-4a01-832e-36f50816fb84 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:58.210073 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-323b55be-d954-4a01-832e-36f50816fb84 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:58.324945 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-919b57c9-66dd-4bcf-b419-ce999dfa6d83 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:58.325565 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-919b57c9-66dd-4bcf-b419-ce999dfa6d83 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:58.344550 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-919b57c9-66dd-4bcf-b419-ce999dfa6d83 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:58.347106 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-919b57c9-66dd-4bcf-b419-ce999dfa6d83 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:58.348748 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-919b57c9-66dd-4bcf-b419-ce999dfa6d83 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:58.352946 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-919b57c9-66dd-4bcf-b419-ce999dfa6d83 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:58.408872 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-323b55be-d954-4a01-832e-36f50816fb84 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:58.418943 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-323b55be-d954-4a01-832e-36f50816fb84 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:58.420458 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-323b55be-d954-4a01-832e-36f50816fb84 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:58.421606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-323b55be-d954-4a01-832e-36f50816fb84 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.226058 Jul 27 07:53:58.422162 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 284/580] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:53:58 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:53:58.528631 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-919b57c9-66dd-4bcf-b419-ce999dfa6d83 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:58.537829 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-919b57c9-66dd-4bcf-b419-ce999dfa6d83 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1723 microversion: 2.1 time: 0.217916 Jul 27 07:53:58.538716 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 297/581] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:58 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:53:58.643444 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2578abb0-1a26-4010-a60e-fb6822493948 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:58.644052 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2578abb0-1a26-4010-a60e-fb6822493948 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:58.651009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2578abb0-1a26-4010-a60e-fb6822493948 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:58.651457 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2578abb0-1a26-4010-a60e-fb6822493948 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:58.652274 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2578abb0-1a26-4010-a60e-fb6822493948 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:58.652657 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2578abb0-1a26-4010-a60e-fb6822493948 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:58.802791 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2578abb0-1a26-4010-a60e-fb6822493948 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:58.814765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2578abb0-1a26-4010-a60e-fb6822493948 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 200 len: 1366 microversion: 2.1 time: 0.175045 Jul 27 07:53:58.817490 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 285/582] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:58 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:53:59.444414 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-bdba2da6-d226-4ecb-94d9-37acc87d9267 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:59.445117 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-bdba2da6-d226-4ecb-94d9-37acc87d9267 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:59.452660 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bdba2da6-d226-4ecb-94d9-37acc87d9267 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:59.453195 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bdba2da6-d226-4ecb-94d9-37acc87d9267 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:59.454057 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bdba2da6-d226-4ecb-94d9-37acc87d9267 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:59.454775 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bdba2da6-d226-4ecb-94d9-37acc87d9267 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:59.562803 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-07d5704f-08e5-4ed1-9a2c-2bb0d0de8088 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:59.564205 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-07d5704f-08e5-4ed1-9a2c-2bb0d0de8088 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:59.572327 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-07d5704f-08e5-4ed1-9a2c-2bb0d0de8088 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:59.573090 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-07d5704f-08e5-4ed1-9a2c-2bb0d0de8088 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:59.574669 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-07d5704f-08e5-4ed1-9a2c-2bb0d0de8088 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:59.575475 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-07d5704f-08e5-4ed1-9a2c-2bb0d0de8088 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:59.596755 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bdba2da6-d226-4ecb-94d9-37acc87d9267 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:59.606222 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bdba2da6-d226-4ecb-94d9-37acc87d9267 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:59.608910 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bdba2da6-d226-4ecb-94d9-37acc87d9267 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:59.610330 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-bdba2da6-d226-4ecb-94d9-37acc87d9267 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.169839 Jul 27 07:53:59.611100 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 298/583] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:53:59 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:53:59.715020 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-07d5704f-08e5-4ed1-9a2c-2bb0d0de8088 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:53:59.723548 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-07d5704f-08e5-4ed1-9a2c-2bb0d0de8088 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1723 microversion: 2.1 time: 0.164618 Jul 27 07:53:59.724466 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 286/584] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:59 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:53:59.837837 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-231b7295-bb1b-4e29-ac23-ac01c2cf39cb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:53:59.838486 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-231b7295-bb1b-4e29-ac23-ac01c2cf39cb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:53:59.842281 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:53:59.847349 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-231b7295-bb1b-4e29-ac23-ac01c2cf39cb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:59.847811 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-231b7295-bb1b-4e29-ac23-ac01c2cf39cb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:53:59.848915 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-231b7295-bb1b-4e29-ac23-ac01c2cf39cb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:53:59.849352 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-231b7295-bb1b-4e29-ac23-ac01c2cf39cb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:00.000562 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-231b7295-bb1b-4e29-ac23-ac01c2cf39cb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:00.009259 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-231b7295-bb1b-4e29-ac23-ac01c2cf39cb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 200 len: 1366 microversion: 2.1 time: 0.175927 Jul 27 07:54:00.010147 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 299/585] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:53:59 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:00.633992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ec0900be-09e7-42be-a40c-4e30edae91e2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:00.635663 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ec0900be-09e7-42be-a40c-4e30edae91e2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:00.642857 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ec0900be-09e7-42be-a40c-4e30edae91e2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:00.643447 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ec0900be-09e7-42be-a40c-4e30edae91e2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:00.644477 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ec0900be-09e7-42be-a40c-4e30edae91e2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:00.645307 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ec0900be-09e7-42be-a40c-4e30edae91e2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:00.752140 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-464426fc-3290-4ce5-bc22-76d16d3f8a97 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:00.753908 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-464426fc-3290-4ce5-bc22-76d16d3f8a97 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:00.761758 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-464426fc-3290-4ce5-bc22-76d16d3f8a97 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:00.762674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-464426fc-3290-4ce5-bc22-76d16d3f8a97 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:00.764342 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-464426fc-3290-4ce5-bc22-76d16d3f8a97 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:00.765394 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-464426fc-3290-4ce5-bc22-76d16d3f8a97 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:00.828621 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ec0900be-09e7-42be-a40c-4e30edae91e2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:00.842235 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ec0900be-09e7-42be-a40c-4e30edae91e2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:00.844263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ec0900be-09e7-42be-a40c-4e30edae91e2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:00.847958 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ec0900be-09e7-42be-a40c-4e30edae91e2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.217797 Jul 27 07:54:00.852075 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 287/586] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:00 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:00.940135 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-464426fc-3290-4ce5-bc22-76d16d3f8a97 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:00.949622 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-464426fc-3290-4ce5-bc22-76d16d3f8a97 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1723 microversion: 2.1 time: 0.205900 Jul 27 07:54:00.950185 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 300/587] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:00 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:01.031104 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0c9ee3ac-a715-4f25-a1d8-20388822e3a2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:01.031759 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0c9ee3ac-a715-4f25-a1d8-20388822e3a2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:01.038195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0c9ee3ac-a715-4f25-a1d8-20388822e3a2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:01.038639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0c9ee3ac-a715-4f25-a1d8-20388822e3a2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:01.040756 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0c9ee3ac-a715-4f25-a1d8-20388822e3a2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:01.040756 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0c9ee3ac-a715-4f25-a1d8-20388822e3a2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:01.190589 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0c9ee3ac-a715-4f25-a1d8-20388822e3a2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:01.198362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0c9ee3ac-a715-4f25-a1d8-20388822e3a2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 200 len: 1366 microversion: 2.1 time: 0.171059 Jul 27 07:54:01.199592 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 288/588] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:01 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:01.874148 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-48163d60-d62f-4e7f-b276-d2081deb474f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:01.874756 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-48163d60-d62f-4e7f-b276-d2081deb474f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:01.876665 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:01.877340 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=6 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:01.884355 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-48163d60-d62f-4e7f-b276-d2081deb474f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:01.884803 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-48163d60-d62f-4e7f-b276-d2081deb474f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:01.885581 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-48163d60-d62f-4e7f-b276-d2081deb474f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:01.886361 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-48163d60-d62f-4e7f-b276-d2081deb474f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:01.967698 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=6 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:01.972863 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-6b112586-f6ca-4a21-9af6-621b58882013 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:01.973552 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-6b112586-f6ca-4a21-9af6-621b58882013 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:01.979679 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6b112586-f6ca-4a21-9af6-621b58882013 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:01.980480 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6b112586-f6ca-4a21-9af6-621b58882013 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:01.981259 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6b112586-f6ca-4a21-9af6-621b58882013 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:01.981862 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6b112586-f6ca-4a21-9af6-621b58882013 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:01.986593 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=100 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:02.027786 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-48163d60-d62f-4e7f-b276-d2081deb474f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:02.036221 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-48163d60-d62f-4e7f-b276-d2081deb474f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:02.037894 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-48163d60-d62f-4e7f-b276-d2081deb474f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:02.039145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-48163d60-d62f-4e7f-b276-d2081deb474f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.168944 Jul 27 07:54:02.039708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 301/589] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:01 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:02.118058 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-6b112586-f6ca-4a21-9af6-621b58882013 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:02.126203 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-6b112586-f6ca-4a21-9af6-621b58882013 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1723 microversion: 2.1 time: 0.159240 Jul 27 07:54:02.126769 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 289/590] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:01 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:02.220924 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-012640cb-c046-4fb5-8a62-7f69026f0f98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:02.221533 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-012640cb-c046-4fb5-8a62-7f69026f0f98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:02.228039 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-012640cb-c046-4fb5-8a62-7f69026f0f98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:02.228440 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-012640cb-c046-4fb5-8a62-7f69026f0f98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:02.229217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-012640cb-c046-4fb5-8a62-7f69026f0f98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:02.229655 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-012640cb-c046-4fb5-8a62-7f69026f0f98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:02.365704 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-012640cb-c046-4fb5-8a62-7f69026f0f98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:02.373701 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-012640cb-c046-4fb5-8a62-7f69026f0f98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 200 len: 1366 microversion: 2.1 time: 0.156537 Jul 27 07:54:02.374156 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 302/591] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:02 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:03.063325 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1ca863c2-01c0-45b5-b247-90b66cf4a7cc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:03.064360 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1ca863c2-01c0-45b5-b247-90b66cf4a7cc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:03.072386 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1ca863c2-01c0-45b5-b247-90b66cf4a7cc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:03.072953 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1ca863c2-01c0-45b5-b247-90b66cf4a7cc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:03.073992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1ca863c2-01c0-45b5-b247-90b66cf4a7cc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:03.074425 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1ca863c2-01c0-45b5-b247-90b66cf4a7cc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:03.147259 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-68aedfbf-8d5f-4ce6-a05d-9cc65b7db2b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:03.147978 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-68aedfbf-8d5f-4ce6-a05d-9cc65b7db2b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:03.155421 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-68aedfbf-8d5f-4ce6-a05d-9cc65b7db2b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:03.156238 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-68aedfbf-8d5f-4ce6-a05d-9cc65b7db2b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:03.157110 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-68aedfbf-8d5f-4ce6-a05d-9cc65b7db2b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:03.157628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-68aedfbf-8d5f-4ce6-a05d-9cc65b7db2b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:03.220524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1ca863c2-01c0-45b5-b247-90b66cf4a7cc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:03.229441 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1ca863c2-01c0-45b5-b247-90b66cf4a7cc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:03.231038 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1ca863c2-01c0-45b5-b247-90b66cf4a7cc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:03.232205 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1ca863c2-01c0-45b5-b247-90b66cf4a7cc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.173613 Jul 27 07:54:03.232765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 290/592] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:03 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:03.297541 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-68aedfbf-8d5f-4ce6-a05d-9cc65b7db2b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:03.306067 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-68aedfbf-8d5f-4ce6-a05d-9cc65b7db2b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1723 microversion: 2.1 time: 0.162848 Jul 27 07:54:03.306625 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 303/593] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:03 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:54:03.394520 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-55d1a2c8-e514-4613-95d4-000bddeb6be6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:03.395256 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-55d1a2c8-e514-4613-95d4-000bddeb6be6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:03.404370 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-55d1a2c8-e514-4613-95d4-000bddeb6be6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:03.404810 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-55d1a2c8-e514-4613-95d4-000bddeb6be6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:03.405567 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-55d1a2c8-e514-4613-95d4-000bddeb6be6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:03.406028 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-55d1a2c8-e514-4613-95d4-000bddeb6be6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:03.539004 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-55d1a2c8-e514-4613-95d4-000bddeb6be6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:03.546482 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-55d1a2c8-e514-4613-95d4-000bddeb6be6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 200 len: 1366 microversion: 2.1 time: 0.156113 Jul 27 07:54:03.546991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 291/594] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:03 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:03.806564 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-e1b00d6b-6435-40a9-9b76-a979cd53b5dd req-8be3f772-548b-4da6-a177-34fde3afa0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40e1f19-e3f4-4bc2-96d5-711703b48a28", "name": "network-vif-plugged", "status": "completed", "tag": "2179df90-07c1-42e0-9748-4b2d651be4ca"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:54:03.816400 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-e1b00d6b-6435-40a9-9b76-a979cd53b5dd req-8be3f772-548b-4da6-a177-34fde3afa0b6 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:03.817010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-e1b00d6b-6435-40a9-9b76-a979cd53b5dd req-8be3f772-548b-4da6-a177-34fde3afa0b6 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:03.829437 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-e1b00d6b-6435-40a9-9b76-a979cd53b5dd req-8be3f772-548b-4da6-a177-34fde3afa0b6 service nova] Creating event network-vif-plugged:2179df90-07c1-42e0-9748-4b2d651be4ca for instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 on hv-cinder-82549 Jul 27 07:54:03.834493 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-e1b00d6b-6435-40a9-9b76-a979cd53b5dd req-8be3f772-548b-4da6-a177-34fde3afa0b6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031587 Jul 27 07:54:03.835348 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 304/595] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:54:04.260851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-193c1269-16d0-4215-aaf0-2f169c472bba tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:04.261456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-193c1269-16d0-4215-aaf0-2f169c472bba tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:04.268881 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-193c1269-16d0-4215-aaf0-2f169c472bba tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:04.269334 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-193c1269-16d0-4215-aaf0-2f169c472bba tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:04.270116 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-193c1269-16d0-4215-aaf0-2f169c472bba tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:04.270549 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-193c1269-16d0-4215-aaf0-2f169c472bba tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:04.329634 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f4da8005-545e-4405-b8f4-ab7352375ccb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:04.330336 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f4da8005-545e-4405-b8f4-ab7352375ccb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:04.337310 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f4da8005-545e-4405-b8f4-ab7352375ccb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:04.338008 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f4da8005-545e-4405-b8f4-ab7352375ccb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:04.339062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f4da8005-545e-4405-b8f4-ab7352375ccb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:04.339683 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f4da8005-545e-4405-b8f4-ab7352375ccb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:04.426439 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-193c1269-16d0-4215-aaf0-2f169c472bba tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:04.436529 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-193c1269-16d0-4215-aaf0-2f169c472bba tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:04.438175 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-193c1269-16d0-4215-aaf0-2f169c472bba tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:04.439469 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-193c1269-16d0-4215-aaf0-2f169c472bba tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.182512 Jul 27 07:54:04.440119 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 292/596] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:04 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:04.556458 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f4da8005-545e-4405-b8f4-ab7352375ccb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:04.565730 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f4da8005-545e-4405-b8f4-ab7352375ccb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1723 microversion: 2.1 time: 0.240357 Jul 27 07:54:04.575780 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 305/597] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:04 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:04.575968 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-049864de-263e-43a2-855e-7cdef250045c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:04.575968 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-049864de-263e-43a2-855e-7cdef250045c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:04.575968 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-049864de-263e-43a2-855e-7cdef250045c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:04.575968 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-049864de-263e-43a2-855e-7cdef250045c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:04.576341 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-049864de-263e-43a2-855e-7cdef250045c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:04.576341 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-049864de-263e-43a2-855e-7cdef250045c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:04.730292 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-049864de-263e-43a2-855e-7cdef250045c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:04.738483 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-049864de-263e-43a2-855e-7cdef250045c tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 200 len: 1366 microversion: 2.1 time: 0.175113 Jul 27 07:54:04.739098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 293/598] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:04 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:54:05.466431 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1ed9def5-a06e-48e2-8949-8b9030ce60d2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:05.467084 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1ed9def5-a06e-48e2-8949-8b9030ce60d2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:05.474141 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1ed9def5-a06e-48e2-8949-8b9030ce60d2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:05.474636 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1ed9def5-a06e-48e2-8949-8b9030ce60d2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:05.475450 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1ed9def5-a06e-48e2-8949-8b9030ce60d2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:05.475888 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1ed9def5-a06e-48e2-8949-8b9030ce60d2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:05.588501 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1217e309-c9ac-45ad-b5ea-1629b12663ea tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:05.589322 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1217e309-c9ac-45ad-b5ea-1629b12663ea tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:05.596664 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1217e309-c9ac-45ad-b5ea-1629b12663ea tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:05.597342 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1217e309-c9ac-45ad-b5ea-1629b12663ea tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:05.598528 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1217e309-c9ac-45ad-b5ea-1629b12663ea tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:05.599157 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1217e309-c9ac-45ad-b5ea-1629b12663ea tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:05.612530 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1ed9def5-a06e-48e2-8949-8b9030ce60d2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:05.624232 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1ed9def5-a06e-48e2-8949-8b9030ce60d2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:05.626553 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1ed9def5-a06e-48e2-8949-8b9030ce60d2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:05.628142 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1ed9def5-a06e-48e2-8949-8b9030ce60d2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.167531 Jul 27 07:54:05.631220 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 306/599] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:05 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:05.750864 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1217e309-c9ac-45ad-b5ea-1629b12663ea tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:05.761030 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1217e309-c9ac-45ad-b5ea-1629b12663ea tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1723 microversion: 2.1 time: 0.176528 Jul 27 07:54:05.761257 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c9ade054-f2df-4527-a410-e23f236bfeef tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:05.761784 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 294/600] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:05 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:54:05.762295 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c9ade054-f2df-4527-a410-e23f236bfeef tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:05.768599 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9ade054-f2df-4527-a410-e23f236bfeef tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:05.769250 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9ade054-f2df-4527-a410-e23f236bfeef tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:05.770160 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9ade054-f2df-4527-a410-e23f236bfeef tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:05.770600 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9ade054-f2df-4527-a410-e23f236bfeef tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:05.789344 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:05.955239 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c9ade054-f2df-4527-a410-e23f236bfeef tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:05.963623 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c9ade054-f2df-4527-a410-e23f236bfeef tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 200 len: 1366 microversion: 2.1 time: 0.207164 Jul 27 07:54:05.964202 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 307/601] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:05 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:54:06.651755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a5bf1bac-1e42-436a-966a-cef3f6f3eea2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:06.652393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a5bf1bac-1e42-436a-966a-cef3f6f3eea2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:06.659370 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a5bf1bac-1e42-436a-966a-cef3f6f3eea2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:06.659895 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a5bf1bac-1e42-436a-966a-cef3f6f3eea2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:06.660592 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a5bf1bac-1e42-436a-966a-cef3f6f3eea2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:06.661243 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a5bf1bac-1e42-436a-966a-cef3f6f3eea2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:06.788715 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f73a1b5b-c859-44b8-8990-d334da5f021a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:06.790551 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f73a1b5b-c859-44b8-8990-d334da5f021a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:06.798829 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f73a1b5b-c859-44b8-8990-d334da5f021a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:06.799549 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f73a1b5b-c859-44b8-8990-d334da5f021a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:06.801235 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f73a1b5b-c859-44b8-8990-d334da5f021a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:06.801836 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f73a1b5b-c859-44b8-8990-d334da5f021a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:06.807518 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a5bf1bac-1e42-436a-966a-cef3f6f3eea2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:06.818076 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a5bf1bac-1e42-436a-966a-cef3f6f3eea2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:06.819854 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a5bf1bac-1e42-436a-966a-cef3f6f3eea2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:06.823609 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a5bf1bac-1e42-436a-966a-cef3f6f3eea2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.175753 Jul 27 07:54:06.824177 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 295/602] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:06 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:06.985792 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-be95afae-b4ce-45e1-8582-cfe592e33d9b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:06.986649 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-be95afae-b4ce-45e1-8582-cfe592e33d9b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:06.993371 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-be95afae-b4ce-45e1-8582-cfe592e33d9b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:06.994038 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-be95afae-b4ce-45e1-8582-cfe592e33d9b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:06.995101 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-be95afae-b4ce-45e1-8582-cfe592e33d9b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:06.995710 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-be95afae-b4ce-45e1-8582-cfe592e33d9b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:07.100568 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f73a1b5b-c859-44b8-8990-d334da5f021a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:07.110878 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f73a1b5b-c859-44b8-8990-d334da5f021a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1723 microversion: 2.1 time: 0.330685 Jul 27 07:54:07.119274 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 308/603] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:06 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:07.160640 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-be95afae-b4ce-45e1-8582-cfe592e33d9b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:07.169919 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-be95afae-b4ce-45e1-8582-cfe592e33d9b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 200 len: 1366 microversion: 2.1 time: 0.188309 Jul 27 07:54:07.177528 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 296/604] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:06 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:07.848544 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3aba8238-ce2d-447c-b205-6d6b11f6d8b0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:07.849314 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3aba8238-ce2d-447c-b205-6d6b11f6d8b0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:07.858813 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3aba8238-ce2d-447c-b205-6d6b11f6d8b0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:07.859946 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3aba8238-ce2d-447c-b205-6d6b11f6d8b0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:07.860945 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3aba8238-ce2d-447c-b205-6d6b11f6d8b0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:07.861963 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3aba8238-ce2d-447c-b205-6d6b11f6d8b0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:08.060881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3aba8238-ce2d-447c-b205-6d6b11f6d8b0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:08.069377 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3aba8238-ce2d-447c-b205-6d6b11f6d8b0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:08.071486 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3aba8238-ce2d-447c-b205-6d6b11f6d8b0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:08.072667 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3aba8238-ce2d-447c-b205-6d6b11f6d8b0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1746 microversion: 2.20 time: 0.228335 Jul 27 07:54:08.073276 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 309/605] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:07 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1746 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:08.143152 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-cc98daec-8bde-4d17-9f11-aefa77aa70a6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:08.155912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-cc98daec-8bde-4d17-9f11-aefa77aa70a6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:08.166628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cc98daec-8bde-4d17-9f11-aefa77aa70a6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:08.167381 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cc98daec-8bde-4d17-9f11-aefa77aa70a6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:08.168390 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cc98daec-8bde-4d17-9f11-aefa77aa70a6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:08.170528 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cc98daec-8bde-4d17-9f11-aefa77aa70a6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:08.191079 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e3011ab5-9a24-4d14-ae23-e2647a1a05c3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:08.191792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e3011ab5-9a24-4d14-ae23-e2647a1a05c3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:08.201268 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e3011ab5-9a24-4d14-ae23-e2647a1a05c3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:08.203506 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e3011ab5-9a24-4d14-ae23-e2647a1a05c3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:08.204548 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e3011ab5-9a24-4d14-ae23-e2647a1a05c3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:08.205211 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e3011ab5-9a24-4d14-ae23-e2647a1a05c3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:08.355888 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-cc98daec-8bde-4d17-9f11-aefa77aa70a6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:08.365087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-cc98daec-8bde-4d17-9f11-aefa77aa70a6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1723 microversion: 2.1 time: 0.236567 Jul 27 07:54:08.366288 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 297/606] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:08 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:54:08.626282 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e3011ab5-9a24-4d14-ae23-e2647a1a05c3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:08.634554 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e3011ab5-9a24-4d14-ae23-e2647a1a05c3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 200 len: 1557 microversion: 2.1 time: 0.447304 Jul 27 07:54:08.635843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 310/607] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:08 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 1557 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:54:08.656174 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-147e2bfb-d9cc-4074-a66f-2a851cd49abb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:08.656695 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-147e2bfb-d9cc-4074-a66f-2a851cd49abb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:08.663151 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-147e2bfb-d9cc-4074-a66f-2a851cd49abb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:08.663912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-147e2bfb-d9cc-4074-a66f-2a851cd49abb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:08.664847 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-147e2bfb-d9cc-4074-a66f-2a851cd49abb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:08.665438 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-147e2bfb-d9cc-4074-a66f-2a851cd49abb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:08.789471 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-147e2bfb-d9cc-4074-a66f-2a851cd49abb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.137122 Jul 27 07:54:08.790072 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 298/608] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Jul 27 07:54:08 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:54:09.097520 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-bd46fda3-e8b9-476d-a5cb-53ce8991067d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:09.099063 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-bd46fda3-e8b9-476d-a5cb-53ce8991067d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:09.108694 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bd46fda3-e8b9-476d-a5cb-53ce8991067d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:09.109567 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bd46fda3-e8b9-476d-a5cb-53ce8991067d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:09.111358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bd46fda3-e8b9-476d-a5cb-53ce8991067d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:09.112099 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bd46fda3-e8b9-476d-a5cb-53ce8991067d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:09.337823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bd46fda3-e8b9-476d-a5cb-53ce8991067d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:09.353095 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bd46fda3-e8b9-476d-a5cb-53ce8991067d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:09.355829 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bd46fda3-e8b9-476d-a5cb-53ce8991067d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:09.357873 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-bd46fda3-e8b9-476d-a5cb-53ce8991067d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1746 microversion: 2.20 time: 0.264533 Jul 27 07:54:09.359878 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 311/609] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:09 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1746 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:09.388428 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-12adc4f5-04bf-41db-ae11-2678f8ab92cb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:09.389796 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-12adc4f5-04bf-41db-ae11-2678f8ab92cb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:09.413346 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-12adc4f5-04bf-41db-ae11-2678f8ab92cb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:09.415439 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-12adc4f5-04bf-41db-ae11-2678f8ab92cb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:09.419006 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-12adc4f5-04bf-41db-ae11-2678f8ab92cb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:09.419668 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-12adc4f5-04bf-41db-ae11-2678f8ab92cb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:09.677542 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-12adc4f5-04bf-41db-ae11-2678f8ab92cb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:09.694604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-12adc4f5-04bf-41db-ae11-2678f8ab92cb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1723 microversion: 2.1 time: 0.310906 Jul 27 07:54:09.696425 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 299/610] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:09 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:09.968554 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-4dd4ac07-8b90-48ea-9022-307a7713a5e0 req-e54f14c5-04cc-40db-a2ef-9262340dca26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a40e1f19-e3f4-4bc2-96d5-711703b48a28", "tag": "2179df90-07c1-42e0-9748-4b2d651be4ca"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:54:09.980735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-4dd4ac07-8b90-48ea-9022-307a7713a5e0 req-e54f14c5-04cc-40db-a2ef-9262340dca26 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:09.981179 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-4dd4ac07-8b90-48ea-9022-307a7713a5e0 req-e54f14c5-04cc-40db-a2ef-9262340dca26 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:10.011839 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-4dd4ac07-8b90-48ea-9022-307a7713a5e0 req-e54f14c5-04cc-40db-a2ef-9262340dca26 service nova] Creating event network-changed:2179df90-07c1-42e0-9748-4b2d651be4ca for instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 on hv-cinder-82549 Jul 27 07:54:10.022077 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-4dd4ac07-8b90-48ea-9022-307a7713a5e0 req-e54f14c5-04cc-40db-a2ef-9262340dca26 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056264 Jul 27 07:54:10.023484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 312/611] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:54:10.384895 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-adf888f6-3aad-44ee-a400-6cd4d24d559e req-79863c5f-1a0f-4327-9ae6-a7312c43117c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "880126db-79f5-4c11-a0b5-85a612a1662a", "name": "network-vif-plugged", "status": "completed", "tag": "4acbfc37-e1fc-4b8f-a717-ec89154e30e4"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:54:10.390112 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e368a423-34ff-492a-9879-56df667e1fcf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:10.390725 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e368a423-34ff-492a-9879-56df667e1fcf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:10.400100 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e368a423-34ff-492a-9879-56df667e1fcf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:10.403548 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e368a423-34ff-492a-9879-56df667e1fcf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:10.404716 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e368a423-34ff-492a-9879-56df667e1fcf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:10.406275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e368a423-34ff-492a-9879-56df667e1fcf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:10.408613 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-adf888f6-3aad-44ee-a400-6cd4d24d559e req-79863c5f-1a0f-4327-9ae6-a7312c43117c service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:10.413684 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-adf888f6-3aad-44ee-a400-6cd4d24d559e req-79863c5f-1a0f-4327-9ae6-a7312c43117c service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:10.452288 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-adf888f6-3aad-44ee-a400-6cd4d24d559e req-79863c5f-1a0f-4327-9ae6-a7312c43117c service nova] Creating event network-vif-plugged:4acbfc37-e1fc-4b8f-a717-ec89154e30e4 for instance 880126db-79f5-4c11-a0b5-85a612a1662a on hv-cinder-82549 Jul 27 07:54:10.460553 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-adf888f6-3aad-44ee-a400-6cd4d24d559e req-79863c5f-1a0f-4327-9ae6-a7312c43117c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080512 Jul 27 07:54:10.465772 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 313/612] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:54:10.717796 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f6c78623-eb32-40bf-90f6-041b2319efa7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:10.718703 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f6c78623-eb32-40bf-90f6-041b2319efa7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:10.725979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f6c78623-eb32-40bf-90f6-041b2319efa7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:10.726712 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f6c78623-eb32-40bf-90f6-041b2319efa7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:10.727695 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f6c78623-eb32-40bf-90f6-041b2319efa7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:10.733993 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f6c78623-eb32-40bf-90f6-041b2319efa7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:10.792258 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e368a423-34ff-492a-9879-56df667e1fcf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:10.817536 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e368a423-34ff-492a-9879-56df667e1fcf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:10.825545 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e368a423-34ff-492a-9879-56df667e1fcf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:10.831250 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e368a423-34ff-492a-9879-56df667e1fcf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1746 microversion: 2.20 time: 0.452705 Jul 27 07:54:10.834212 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 300/613] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:10 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1746 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:10.928727 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f6c78623-eb32-40bf-90f6-041b2319efa7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:10.938454 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f6c78623-eb32-40bf-90f6-041b2319efa7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1723 microversion: 2.1 time: 0.224696 Jul 27 07:54:10.939085 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 314/614] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:10 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:54:11.858785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-46e54577-fcb5-476b-87f2-e3549961e548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:11.859555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-46e54577-fcb5-476b-87f2-e3549961e548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:11.868038 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-46e54577-fcb5-476b-87f2-e3549961e548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:11.868489 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-46e54577-fcb5-476b-87f2-e3549961e548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:11.869328 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-46e54577-fcb5-476b-87f2-e3549961e548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:11.869800 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-46e54577-fcb5-476b-87f2-e3549961e548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:11.960158 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-dd45fd71-25de-4a85-99e9-a7ac91de189d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:11.960870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-dd45fd71-25de-4a85-99e9-a7ac91de189d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:11.968066 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dd45fd71-25de-4a85-99e9-a7ac91de189d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:11.968522 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dd45fd71-25de-4a85-99e9-a7ac91de189d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:11.969304 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dd45fd71-25de-4a85-99e9-a7ac91de189d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:11.969741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dd45fd71-25de-4a85-99e9-a7ac91de189d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:12.030053 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-46e54577-fcb5-476b-87f2-e3549961e548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:12.038563 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-46e54577-fcb5-476b-87f2-e3549961e548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:12.040702 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-46e54577-fcb5-476b-87f2-e3549961e548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:12.041960 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-46e54577-fcb5-476b-87f2-e3549961e548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1746 microversion: 2.20 time: 0.188296 Jul 27 07:54:12.042596 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 301/615] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:11 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1746 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:12.245823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-dd45fd71-25de-4a85-99e9-a7ac91de189d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:12.266497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-dd45fd71-25de-4a85-99e9-a7ac91de189d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1723 microversion: 2.1 time: 0.306960 Jul 27 07:54:12.267794 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 315/616] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:11 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:13.069232 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-041e9845-20d8-4ea0-893e-7772c2fe0f68 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:13.070684 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-041e9845-20d8-4ea0-893e-7772c2fe0f68 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:13.086347 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-041e9845-20d8-4ea0-893e-7772c2fe0f68 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:13.086994 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-041e9845-20d8-4ea0-893e-7772c2fe0f68 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:13.087842 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-041e9845-20d8-4ea0-893e-7772c2fe0f68 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:13.088282 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-041e9845-20d8-4ea0-893e-7772c2fe0f68 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:13.279586 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-041e9845-20d8-4ea0-893e-7772c2fe0f68 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:13.292255 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1c86f869-172f-496b-befe-8fda6dea98dc tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:13.296253 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1c86f869-172f-496b-befe-8fda6dea98dc tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:13.315128 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-041e9845-20d8-4ea0-893e-7772c2fe0f68 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:13.316992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1c86f869-172f-496b-befe-8fda6dea98dc tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:13.319181 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-041e9845-20d8-4ea0-893e-7772c2fe0f68 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:13.320667 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1c86f869-172f-496b-befe-8fda6dea98dc tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:13.322919 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1c86f869-172f-496b-befe-8fda6dea98dc tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:13.324234 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-041e9845-20d8-4ea0-893e-7772c2fe0f68 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1746 microversion: 2.20 time: 0.262247 Jul 27 07:54:13.324958 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1c86f869-172f-496b-befe-8fda6dea98dc tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:13.328112 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 302/617] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:13 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1746 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:54:13.658035 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1c86f869-172f-496b-befe-8fda6dea98dc tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:13.669809 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1c86f869-172f-496b-befe-8fda6dea98dc tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1723 microversion: 2.1 time: 0.384378 Jul 27 07:54:13.684591 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 316/618] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:13 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:14.354389 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-75d6b001-af29-4235-81c2-4268b326bcc7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:14.355426 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-75d6b001-af29-4235-81c2-4268b326bcc7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:14.363981 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-75d6b001-af29-4235-81c2-4268b326bcc7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:14.363981 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-75d6b001-af29-4235-81c2-4268b326bcc7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:14.367496 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-75d6b001-af29-4235-81c2-4268b326bcc7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:14.367496 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-75d6b001-af29-4235-81c2-4268b326bcc7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:14.540036 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-75d6b001-af29-4235-81c2-4268b326bcc7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:14.551959 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-75d6b001-af29-4235-81c2-4268b326bcc7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:14.553435 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-75d6b001-af29-4235-81c2-4268b326bcc7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:14.554672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-75d6b001-af29-4235-81c2-4268b326bcc7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1746 microversion: 2.20 time: 0.204461 Jul 27 07:54:14.558632 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 303/619] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:14 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1746 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:14.692405 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-733d6a0c-82cf-41f1-bf0d-8c8a11a831a0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:14.693861 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-733d6a0c-82cf-41f1-bf0d-8c8a11a831a0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:14.700931 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-733d6a0c-82cf-41f1-bf0d-8c8a11a831a0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:14.701661 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-733d6a0c-82cf-41f1-bf0d-8c8a11a831a0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:14.702618 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-733d6a0c-82cf-41f1-bf0d-8c8a11a831a0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:14.703292 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-733d6a0c-82cf-41f1-bf0d-8c8a11a831a0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:14.934274 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-733d6a0c-82cf-41f1-bf0d-8c8a11a831a0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:14.942780 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-733d6a0c-82cf-41f1-bf0d-8c8a11a831a0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1723 microversion: 2.1 time: 0.254279 Jul 27 07:54:14.960503 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 317/620] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:14 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:15.580523 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7c822470-3704-4183-a0c2-f5e3652f3a5d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:15.581949 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-7c822470-3704-4183-a0c2-f5e3652f3a5d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:15.590851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7c822470-3704-4183-a0c2-f5e3652f3a5d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:15.591606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7c822470-3704-4183-a0c2-f5e3652f3a5d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:15.593459 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7c822470-3704-4183-a0c2-f5e3652f3a5d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:15.595462 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7c822470-3704-4183-a0c2-f5e3652f3a5d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:15.945226 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7c822470-3704-4183-a0c2-f5e3652f3a5d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:15.970028 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-cf1484ff-2020-45e9-9168-d8de364aa96c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:15.971674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-cf1484ff-2020-45e9-9168-d8de364aa96c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:15.972319 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7c822470-3704-4183-a0c2-f5e3652f3a5d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:15.974478 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7c822470-3704-4183-a0c2-f5e3652f3a5d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:15.976701 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7c822470-3704-4183-a0c2-f5e3652f3a5d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1741 microversion: 2.20 time: 0.401856 Jul 27 07:54:15.977483 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 304/621] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:15 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1741 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:15.997356 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cf1484ff-2020-45e9-9168-d8de364aa96c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:15.997794 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cf1484ff-2020-45e9-9168-d8de364aa96c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:15.998599 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cf1484ff-2020-45e9-9168-d8de364aa96c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:16.002397 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cf1484ff-2020-45e9-9168-d8de364aa96c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:16.203457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-cf1484ff-2020-45e9-9168-d8de364aa96c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:16.223903 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-cf1484ff-2020-45e9-9168-d8de364aa96c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1723 microversion: 2.1 time: 0.258606 Jul 27 07:54:16.225665 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 318/622] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:15 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:17.002269 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9ac5e34e-29ce-4fc0-9bc5-058a02581f49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:17.002900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-9ac5e34e-29ce-4fc0-9bc5-058a02581f49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:17.016343 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9ac5e34e-29ce-4fc0-9bc5-058a02581f49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:17.017056 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9ac5e34e-29ce-4fc0-9bc5-058a02581f49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:17.018033 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9ac5e34e-29ce-4fc0-9bc5-058a02581f49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:17.018641 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9ac5e34e-29ce-4fc0-9bc5-058a02581f49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:17.246633 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d29eee07-f14b-450f-b133-ef30aa176c3d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:17.247302 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d29eee07-f14b-450f-b133-ef30aa176c3d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:17.260130 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d29eee07-f14b-450f-b133-ef30aa176c3d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:17.260579 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d29eee07-f14b-450f-b133-ef30aa176c3d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:17.261395 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d29eee07-f14b-450f-b133-ef30aa176c3d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:17.261822 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d29eee07-f14b-450f-b133-ef30aa176c3d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:17.535247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d29eee07-f14b-450f-b133-ef30aa176c3d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:17.548694 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d29eee07-f14b-450f-b133-ef30aa176c3d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1723 microversion: 2.1 time: 0.307000 Jul 27 07:54:17.549682 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 319/623] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:17 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1723 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:17.713494 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9ac5e34e-29ce-4fc0-9bc5-058a02581f49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:17.722436 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9ac5e34e-29ce-4fc0-9bc5-058a02581f49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:17.725014 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9ac5e34e-29ce-4fc0-9bc5-058a02581f49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:17.726280 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9ac5e34e-29ce-4fc0-9bc5-058a02581f49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1741 microversion: 2.20 time: 0.727872 Jul 27 07:54:17.734310 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 305/624] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:16 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1741 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:18.351765 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-091949c4-060f-4c8e-812a-9f12976fa7b4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Action: 'create', calling method: .version_select at 0x7f1a02c68af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-361390635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFnycMZmUd3Ma4QpFOa6gs/amDdg39wfCzDnuUI6euqfBJWVGmsJGUV/bvCQJiqevWIma7cvbcRsu3PDbsPGN2FACJTeLJXKuokced1bapLxtZf2VkuE1SN5cpxOl9Wmg=="}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:54:18.370459 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-091949c4-060f-4c8e-812a-9f12976fa7b4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Getting quotas for project d312b027f97e482d82eea4bdd7bb3166. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:54:18.374908 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-091949c4-060f-4c8e-812a-9f12976fa7b4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Getting quotas for user d93f5d182474439bb6ea1d8b70f39b2b and project d312b027f97e482d82eea4bdd7bb3166. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:54:18.402087 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-091949c4-060f-4c8e-812a-9f12976fa7b4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.300005 Jul 27 07:54:18.402730 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 320/625] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Jul 27 07:54:18 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:54:18.578490 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f8b5913f-36bb-4bb2-a64c-32ff357c4713 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:18.579297 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f8b5913f-36bb-4bb2-a64c-32ff357c4713 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:18.596783 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f8b5913f-36bb-4bb2-a64c-32ff357c4713 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:18.599203 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f8b5913f-36bb-4bb2-a64c-32ff357c4713 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:18.600217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f8b5913f-36bb-4bb2-a64c-32ff357c4713 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:18.600670 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f8b5913f-36bb-4bb2-a64c-32ff357c4713 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:18.638484 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=100 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:18.757402 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c9c84379-1e1d-44d0-803c-50deba4ee593 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:18.758543 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c9c84379-1e1d-44d0-803c-50deba4ee593 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:18.769236 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9c84379-1e1d-44d0-803c-50deba4ee593 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:18.769685 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9c84379-1e1d-44d0-803c-50deba4ee593 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:18.770459 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9c84379-1e1d-44d0-803c-50deba4ee593 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:18.770985 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9c84379-1e1d-44d0-803c-50deba4ee593 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:18.828606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f8b5913f-36bb-4bb2-a64c-32ff357c4713 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:18.838360 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f8b5913f-36bb-4bb2-a64c-32ff357c4713 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1700 microversion: 2.1 time: 0.268302 Jul 27 07:54:18.848762 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 306/626] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:18 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1700 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:18.873509 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2c39ecf1-232c-4ba6-91c5-88477b989b32 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:54:18.885000 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2c39ecf1-232c-4ba6-91c5-88477b989b32 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:18.885540 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2c39ecf1-232c-4ba6-91c5-88477b989b32 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:18.994699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c9c84379-1e1d-44d0-803c-50deba4ee593 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:19.006640 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c9c84379-1e1d-44d0-803c-50deba4ee593 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:19.008808 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c9c84379-1e1d-44d0-803c-50deba4ee593 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:19.009096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2c39ecf1-232c-4ba6-91c5-88477b989b32 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Going to try to start instance {{(pid=117779) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 27 07:54:19.010440 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c9c84379-1e1d-44d0-803c-50deba4ee593 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1741 microversion: 2.20 time: 0.257212 Jul 27 07:54:19.015484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 321/627] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:18 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1741 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:19.068463 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2c39ecf1-232c-4ba6-91c5-88477b989b32 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "POST /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979/action" status: 202 len: 0 microversion: 2.1 time: 0.198936 Jul 27 07:54:19.069278 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 307/628] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Jul 27 07:54:18 2022] POST /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 07:54:19.077844 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4400b1b9-6407-4e81-a40b-de76bc122e72 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:19.078748 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4400b1b9-6407-4e81-a40b-de76bc122e72 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:19.095430 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4400b1b9-6407-4e81-a40b-de76bc122e72 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:19.096133 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4400b1b9-6407-4e81-a40b-de76bc122e72 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:19.097414 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4400b1b9-6407-4e81-a40b-de76bc122e72 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:19.098009 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4400b1b9-6407-4e81-a40b-de76bc122e72 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:19.329903 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4400b1b9-6407-4e81-a40b-de76bc122e72 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:19.340200 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4400b1b9-6407-4e81-a40b-de76bc122e72 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1709 microversion: 2.1 time: 0.266570 Jul 27 07:54:19.352363 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 322/629] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:19 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1709 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:20.035909 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2b31dc56-6bdf-423b-8f33-1ef9d373ed08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:20.037317 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2b31dc56-6bdf-423b-8f33-1ef9d373ed08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:20.061206 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2b31dc56-6bdf-423b-8f33-1ef9d373ed08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:20.061672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2b31dc56-6bdf-423b-8f33-1ef9d373ed08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:20.062485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2b31dc56-6bdf-423b-8f33-1ef9d373ed08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:20.062985 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2b31dc56-6bdf-423b-8f33-1ef9d373ed08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:20.331114 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2b31dc56-6bdf-423b-8f33-1ef9d373ed08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:20.341688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2b31dc56-6bdf-423b-8f33-1ef9d373ed08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:20.343860 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2b31dc56-6bdf-423b-8f33-1ef9d373ed08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:20.345409 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2b31dc56-6bdf-423b-8f33-1ef9d373ed08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1741 microversion: 2.20 time: 0.315183 Jul 27 07:54:20.346588 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 308/630] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:20 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1741 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:20.370427 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3beb4b83-075a-4736-8d61-354d90374466 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:20.371093 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3beb4b83-075a-4736-8d61-354d90374466 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:20.380077 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3beb4b83-075a-4736-8d61-354d90374466 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:20.380697 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3beb4b83-075a-4736-8d61-354d90374466 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:20.381464 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3beb4b83-075a-4736-8d61-354d90374466 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:20.381899 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3beb4b83-075a-4736-8d61-354d90374466 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:20.574518 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3beb4b83-075a-4736-8d61-354d90374466 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:20.587093 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3beb4b83-075a-4736-8d61-354d90374466 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1709 microversion: 2.1 time: 0.224773 Jul 27 07:54:20.587930 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 323/631] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:20 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1709 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:21.374377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2bce0aca-0566-42e6-bbaa-46ad112f7c0d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:21.375182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2bce0aca-0566-42e6-bbaa-46ad112f7c0d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:21.381620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2bce0aca-0566-42e6-bbaa-46ad112f7c0d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:21.382224 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2bce0aca-0566-42e6-bbaa-46ad112f7c0d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:21.383132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2bce0aca-0566-42e6-bbaa-46ad112f7c0d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:21.383634 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2bce0aca-0566-42e6-bbaa-46ad112f7c0d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:21.589555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2bce0aca-0566-42e6-bbaa-46ad112f7c0d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:21.607801 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2bce0aca-0566-42e6-bbaa-46ad112f7c0d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:21.609468 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8373fa16-4353-4ed1-9504-9c2c7b5f8b96 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:21.610086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8373fa16-4353-4ed1-9504-9c2c7b5f8b96 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:21.610367 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2bce0aca-0566-42e6-bbaa-46ad112f7c0d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:21.611702 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2bce0aca-0566-42e6-bbaa-46ad112f7c0d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1741 microversion: 2.20 time: 0.241894 Jul 27 07:54:21.612814 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 309/632] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:21 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1741 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:21.642527 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8373fa16-4353-4ed1-9504-9c2c7b5f8b96 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:21.646174 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8373fa16-4353-4ed1-9504-9c2c7b5f8b96 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:21.648404 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8373fa16-4353-4ed1-9504-9c2c7b5f8b96 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:21.649018 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8373fa16-4353-4ed1-9504-9c2c7b5f8b96 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:21.847638 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8373fa16-4353-4ed1-9504-9c2c7b5f8b96 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:21.879055 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8373fa16-4353-4ed1-9504-9c2c7b5f8b96 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1709 microversion: 2.1 time: 0.267959 Jul 27 07:54:21.879746 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 324/633] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:21 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1709 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:22.636768 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f32d3ee6-3fe7-4253-834b-ff046c9151a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:22.638081 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f32d3ee6-3fe7-4253-834b-ff046c9151a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:22.645908 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f32d3ee6-3fe7-4253-834b-ff046c9151a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:22.646978 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f32d3ee6-3fe7-4253-834b-ff046c9151a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:22.648641 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f32d3ee6-3fe7-4253-834b-ff046c9151a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:22.649198 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f32d3ee6-3fe7-4253-834b-ff046c9151a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:22.878919 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f32d3ee6-3fe7-4253-834b-ff046c9151a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:22.894383 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f32d3ee6-3fe7-4253-834b-ff046c9151a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:22.895929 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f32d3ee6-3fe7-4253-834b-ff046c9151a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:22.898165 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f32d3ee6-3fe7-4253-834b-ff046c9151a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1741 microversion: 2.20 time: 0.265238 Jul 27 07:54:22.899123 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 310/634] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:22 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1741 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:22.916973 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5f7ec4fb-86b2-46f0-9997-22adc95ec30c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:22.918069 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5f7ec4fb-86b2-46f0-9997-22adc95ec30c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:22.938200 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5f7ec4fb-86b2-46f0-9997-22adc95ec30c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:22.938656 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5f7ec4fb-86b2-46f0-9997-22adc95ec30c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:22.939499 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5f7ec4fb-86b2-46f0-9997-22adc95ec30c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:22.939931 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5f7ec4fb-86b2-46f0-9997-22adc95ec30c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:23.102371 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5f7ec4fb-86b2-46f0-9997-22adc95ec30c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:23.112201 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5f7ec4fb-86b2-46f0-9997-22adc95ec30c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1713 microversion: 2.1 time: 0.199488 Jul 27 07:54:23.113311 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 325/635] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:22 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1713 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:23.923675 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9fff444f-655d-4bd0-8020-6b29c3b9bcef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:23.924258 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-9fff444f-655d-4bd0-8020-6b29c3b9bcef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:23.940449 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9fff444f-655d-4bd0-8020-6b29c3b9bcef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:23.940899 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9fff444f-655d-4bd0-8020-6b29c3b9bcef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:23.941682 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9fff444f-655d-4bd0-8020-6b29c3b9bcef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:23.942111 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9fff444f-655d-4bd0-8020-6b29c3b9bcef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:24.248389 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9fff444f-655d-4bd0-8020-6b29c3b9bcef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:24.259083 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9fff444f-655d-4bd0-8020-6b29c3b9bcef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:24.261310 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9fff444f-655d-4bd0-8020-6b29c3b9bcef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:24.262502 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9fff444f-655d-4bd0-8020-6b29c3b9bcef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1741 microversion: 2.20 time: 0.343743 Jul 27 07:54:24.263629 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 311/636] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:23 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1741 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:25.288740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-798d72b3-0188-43f6-9f57-43a57c0e9f08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:25.292210 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-798d72b3-0188-43f6-9f57-43a57c0e9f08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:25.301173 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-798d72b3-0188-43f6-9f57-43a57c0e9f08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:25.302219 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-798d72b3-0188-43f6-9f57-43a57c0e9f08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:25.303322 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-798d72b3-0188-43f6-9f57-43a57c0e9f08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:25.304558 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-798d72b3-0188-43f6-9f57-43a57c0e9f08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:25.331086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:25.518372 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-798d72b3-0188-43f6-9f57-43a57c0e9f08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:25.528023 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-798d72b3-0188-43f6-9f57-43a57c0e9f08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:25.529722 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-798d72b3-0188-43f6-9f57-43a57c0e9f08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:25.531380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-798d72b3-0188-43f6-9f57-43a57c0e9f08 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1741 microversion: 2.20 time: 0.248449 Jul 27 07:54:25.532871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 326/637] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:25 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1741 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:26.555902 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-095f7704-aff5-4ce0-9a79-ab2a6120c0fd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:26.556521 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-095f7704-aff5-4ce0-9a79-ab2a6120c0fd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:26.559295 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=62 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:26.566315 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-095f7704-aff5-4ce0-9a79-ab2a6120c0fd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:26.566767 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-095f7704-aff5-4ce0-9a79-ab2a6120c0fd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:26.567596 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-095f7704-aff5-4ce0-9a79-ab2a6120c0fd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:26.568038 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-095f7704-aff5-4ce0-9a79-ab2a6120c0fd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:26.727785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-095f7704-aff5-4ce0-9a79-ab2a6120c0fd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:26.736376 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-095f7704-aff5-4ce0-9a79-ab2a6120c0fd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:26.738136 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-095f7704-aff5-4ce0-9a79-ab2a6120c0fd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:26.739448 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-095f7704-aff5-4ce0-9a79-ab2a6120c0fd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1741 microversion: 2.20 time: 0.188220 Jul 27 07:54:26.740205 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 312/638] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:26 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:27.766566 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-bfdcfc54-e4fb-426c-9e84-79fee1c7b3d0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:27.767199 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-bfdcfc54-e4fb-426c-9e84-79fee1c7b3d0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:27.773621 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bfdcfc54-e4fb-426c-9e84-79fee1c7b3d0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:27.774070 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bfdcfc54-e4fb-426c-9e84-79fee1c7b3d0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:27.774844 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bfdcfc54-e4fb-426c-9e84-79fee1c7b3d0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:27.775417 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bfdcfc54-e4fb-426c-9e84-79fee1c7b3d0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:28.002801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bfdcfc54-e4fb-426c-9e84-79fee1c7b3d0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:28.011354 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bfdcfc54-e4fb-426c-9e84-79fee1c7b3d0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:28.012892 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bfdcfc54-e4fb-426c-9e84-79fee1c7b3d0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:28.014051 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-bfdcfc54-e4fb-426c-9e84-79fee1c7b3d0 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1741 microversion: 2.20 time: 0.251366 Jul 27 07:54:28.014609 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 327/639] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:27 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1741 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:29.040486 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-5f915887-0ae4-4c44-a252-b40ac92a2a2c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:29.041135 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-5f915887-0ae4-4c44-a252-b40ac92a2a2c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:29.048789 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5f915887-0ae4-4c44-a252-b40ac92a2a2c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:29.048789 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5f915887-0ae4-4c44-a252-b40ac92a2a2c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:29.049417 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5f915887-0ae4-4c44-a252-b40ac92a2a2c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:29.050207 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5f915887-0ae4-4c44-a252-b40ac92a2a2c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:29.267385 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-5f915887-0ae4-4c44-a252-b40ac92a2a2c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:29.275979 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-5f915887-0ae4-4c44-a252-b40ac92a2a2c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:29.277483 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-5f915887-0ae4-4c44-a252-b40ac92a2a2c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:29.278644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-5f915887-0ae4-4c44-a252-b40ac92a2a2c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1723 microversion: 2.20 time: 0.242828 Jul 27 07:54:29.279233 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 313/640] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:29 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:30.302472 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-316fd64a-f0b6-4f06-8967-2ce270674230 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:30.303119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-316fd64a-f0b6-4f06-8967-2ce270674230 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:30.305510 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=4 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:30.306766 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:30.312645 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-316fd64a-f0b6-4f06-8967-2ce270674230 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:30.313096 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-316fd64a-f0b6-4f06-8967-2ce270674230 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:30.313862 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-316fd64a-f0b6-4f06-8967-2ce270674230 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:30.314297 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-316fd64a-f0b6-4f06-8967-2ce270674230 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:30.449118 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-316fd64a-f0b6-4f06-8967-2ce270674230 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:30.457069 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-316fd64a-f0b6-4f06-8967-2ce270674230 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:30.458662 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-316fd64a-f0b6-4f06-8967-2ce270674230 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:30.460201 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-316fd64a-f0b6-4f06-8967-2ce270674230 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1723 microversion: 2.20 time: 0.161721 Jul 27 07:54:30.460751 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 328/641] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:30 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:31.483808 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d0fb8f33-04ce-4667-92d5-64b75e01b026 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:31.484561 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d0fb8f33-04ce-4667-92d5-64b75e01b026 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:31.492484 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d0fb8f33-04ce-4667-92d5-64b75e01b026 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:31.492939 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d0fb8f33-04ce-4667-92d5-64b75e01b026 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:31.493719 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d0fb8f33-04ce-4667-92d5-64b75e01b026 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:31.494157 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d0fb8f33-04ce-4667-92d5-64b75e01b026 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:31.693347 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d0fb8f33-04ce-4667-92d5-64b75e01b026 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:31.702113 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d0fb8f33-04ce-4667-92d5-64b75e01b026 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:31.703638 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d0fb8f33-04ce-4667-92d5-64b75e01b026 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:31.704791 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d0fb8f33-04ce-4667-92d5-64b75e01b026 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1723 microversion: 2.20 time: 0.225135 Jul 27 07:54:31.705347 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 314/642] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:31 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:31.920170 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-39c63dce-7e91-47c0-af43-871cbe3c7918 req-d6a05806-74aa-4677-9413-3fee6af63d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "880126db-79f5-4c11-a0b5-85a612a1662a", "name": "network-vif-unplugged", "status": "completed", "tag": "4acbfc37-e1fc-4b8f-a717-ec89154e30e4"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:54:31.931972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-39c63dce-7e91-47c0-af43-871cbe3c7918 req-d6a05806-74aa-4677-9413-3fee6af63d19 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:31.932422 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-39c63dce-7e91-47c0-af43-871cbe3c7918 req-d6a05806-74aa-4677-9413-3fee6af63d19 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:31.945848 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-39c63dce-7e91-47c0-af43-871cbe3c7918 req-d6a05806-74aa-4677-9413-3fee6af63d19 service nova] Creating event network-vif-unplugged:4acbfc37-e1fc-4b8f-a717-ec89154e30e4 for instance 880126db-79f5-4c11-a0b5-85a612a1662a on hv-cinder-82549 Jul 27 07:54:31.951215 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-39c63dce-7e91-47c0-af43-871cbe3c7918 req-d6a05806-74aa-4677-9413-3fee6af63d19 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034741 Jul 27 07:54:31.952097 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 329/643] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:54:32.729756 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-4fd8125d-229f-4074-aa5d-967118fe2a4f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:32.730431 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-4fd8125d-229f-4074-aa5d-967118fe2a4f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:32.737836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4fd8125d-229f-4074-aa5d-967118fe2a4f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:32.738284 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4fd8125d-229f-4074-aa5d-967118fe2a4f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:32.739093 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4fd8125d-229f-4074-aa5d-967118fe2a4f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:32.739518 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4fd8125d-229f-4074-aa5d-967118fe2a4f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:32.882249 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-4fd8125d-229f-4074-aa5d-967118fe2a4f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:32.890973 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-4fd8125d-229f-4074-aa5d-967118fe2a4f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:32.892543 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-4fd8125d-229f-4074-aa5d-967118fe2a4f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:32.893707 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-4fd8125d-229f-4074-aa5d-967118fe2a4f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1666 microversion: 2.20 time: 0.169410 Jul 27 07:54:32.894286 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 315/644] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:32 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1666 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:32.918189 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b44167da-79e3-4543-a831-39e06ea8c9a6 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8401fb67-f4cf-4ac1-a6b2-b1bd57984546"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:54:32.920662 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b44167da-79e3-4543-a831-39e06ea8c9a6 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:32.927682 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b44167da-79e3-4543-a831-39e06ea8c9a6 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:32.928133 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b44167da-79e3-4543-a831-39e06ea8c9a6 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:32.929062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b44167da-79e3-4543-a831-39e06ea8c9a6 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:32.929503 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b44167da-79e3-4543-a831-39e06ea8c9a6 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:33.208232 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b44167da-79e3-4543-a831-39e06ea8c9a6 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "POST /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.294481 Jul 27 07:54:33.208871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 330/645] 10.222.0.18 () {62 vars in 1364 bytes} [Wed Jul 27 07:54:32 2022] POST /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/os-volume_attachments => generated 188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 07:54:33.336438 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-fb1c9d6b-371d-49e7-b9d3-164aedcbfaaa tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:54:33.337001 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-fb1c9d6b-371d-49e7-b9d3-164aedcbfaaa tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:33.343070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fb1c9d6b-371d-49e7-b9d3-164aedcbfaaa tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:33.343514 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fb1c9d6b-371d-49e7-b9d3-164aedcbfaaa tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:33.344272 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fb1c9d6b-371d-49e7-b9d3-164aedcbfaaa tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:33.344703 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fb1c9d6b-371d-49e7-b9d3-164aedcbfaaa tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:33.439123 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-fb1c9d6b-371d-49e7-b9d3-164aedcbfaaa tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "POST /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/action" status: 202 len: 0 microversion: 2.20 time: 0.106636 Jul 27 07:54:33.439767 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 316/646] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Jul 27 07:54:33 2022] POST /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 07:54:33.448936 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d5173273-0ff9-4622-86e6-2a2782d3dcce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:33.449554 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d5173273-0ff9-4622-86e6-2a2782d3dcce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:33.456777 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d5173273-0ff9-4622-86e6-2a2782d3dcce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:33.457230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d5173273-0ff9-4622-86e6-2a2782d3dcce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:33.458009 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d5173273-0ff9-4622-86e6-2a2782d3dcce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:33.458449 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d5173273-0ff9-4622-86e6-2a2782d3dcce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:33.602872 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d5173273-0ff9-4622-86e6-2a2782d3dcce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:33.612691 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d5173273-0ff9-4622-86e6-2a2782d3dcce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:33.622297 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d5173273-0ff9-4622-86e6-2a2782d3dcce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:33.623646 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d5173273-0ff9-4622-86e6-2a2782d3dcce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1752 microversion: 2.20 time: 0.179459 Jul 27 07:54:33.624293 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 331/647] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:33 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:34.649547 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b4d72e8b-0ee6-4efc-8574-42c684b27548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:34.651132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b4d72e8b-0ee6-4efc-8574-42c684b27548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:34.668785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b4d72e8b-0ee6-4efc-8574-42c684b27548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:34.669239 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b4d72e8b-0ee6-4efc-8574-42c684b27548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:34.670011 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b4d72e8b-0ee6-4efc-8574-42c684b27548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:34.670438 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b4d72e8b-0ee6-4efc-8574-42c684b27548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:34.892331 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b4d72e8b-0ee6-4efc-8574-42c684b27548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:34.901214 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b4d72e8b-0ee6-4efc-8574-42c684b27548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:34.902708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b4d72e8b-0ee6-4efc-8574-42c684b27548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:34.903887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b4d72e8b-0ee6-4efc-8574-42c684b27548 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1754 microversion: 2.20 time: 0.260911 Jul 27 07:54:34.904439 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 317/648] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:34 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1754 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:54:35.927614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4bd4ac12-97e0-4f46-89e9-7f8d18dc04fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:35.928228 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4bd4ac12-97e0-4f46-89e9-7f8d18dc04fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:35.934838 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4bd4ac12-97e0-4f46-89e9-7f8d18dc04fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:35.935324 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4bd4ac12-97e0-4f46-89e9-7f8d18dc04fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:35.936090 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4bd4ac12-97e0-4f46-89e9-7f8d18dc04fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:35.936531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4bd4ac12-97e0-4f46-89e9-7f8d18dc04fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:36.071042 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4bd4ac12-97e0-4f46-89e9-7f8d18dc04fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:36.079568 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4bd4ac12-97e0-4f46-89e9-7f8d18dc04fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:36.081100 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4bd4ac12-97e0-4f46-89e9-7f8d18dc04fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:36.082254 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4bd4ac12-97e0-4f46-89e9-7f8d18dc04fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.158577 Jul 27 07:54:36.082901 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 332/649] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:35 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:37.110174 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2eaebe8e-c154-490d-a7de-e41fabef2dac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:37.111828 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2eaebe8e-c154-490d-a7de-e41fabef2dac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:37.121913 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2eaebe8e-c154-490d-a7de-e41fabef2dac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:37.122944 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2eaebe8e-c154-490d-a7de-e41fabef2dac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:37.124425 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2eaebe8e-c154-490d-a7de-e41fabef2dac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:37.125192 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2eaebe8e-c154-490d-a7de-e41fabef2dac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:37.298978 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2eaebe8e-c154-490d-a7de-e41fabef2dac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:37.308966 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2eaebe8e-c154-490d-a7de-e41fabef2dac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:37.310933 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2eaebe8e-c154-490d-a7de-e41fabef2dac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:37.312800 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2eaebe8e-c154-490d-a7de-e41fabef2dac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.209914 Jul 27 07:54:37.327765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 318/650] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:37 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:38.338166 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-47f6a9b8-01f1-4d73-a46e-52d774871c0b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:38.338778 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-47f6a9b8-01f1-4d73-a46e-52d774871c0b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:38.345290 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-47f6a9b8-01f1-4d73-a46e-52d774871c0b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:38.345739 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-47f6a9b8-01f1-4d73-a46e-52d774871c0b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:38.346505 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-47f6a9b8-01f1-4d73-a46e-52d774871c0b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:38.346969 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-47f6a9b8-01f1-4d73-a46e-52d774871c0b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:38.484737 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-47f6a9b8-01f1-4d73-a46e-52d774871c0b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:38.493959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-47f6a9b8-01f1-4d73-a46e-52d774871c0b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:38.495496 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-47f6a9b8-01f1-4d73-a46e-52d774871c0b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:38.496669 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-47f6a9b8-01f1-4d73-a46e-52d774871c0b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.163003 Jul 27 07:54:38.497571 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 333/651] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:38 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:39.521526 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9ed0e8f4-16cc-4e32-9abc-bc579b880f39 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:39.522139 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-9ed0e8f4-16cc-4e32-9abc-bc579b880f39 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:39.528661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9ed0e8f4-16cc-4e32-9abc-bc579b880f39 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:39.529105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9ed0e8f4-16cc-4e32-9abc-bc579b880f39 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:39.529861 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9ed0e8f4-16cc-4e32-9abc-bc579b880f39 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:39.530296 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9ed0e8f4-16cc-4e32-9abc-bc579b880f39 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:39.668725 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9ed0e8f4-16cc-4e32-9abc-bc579b880f39 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:39.677104 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9ed0e8f4-16cc-4e32-9abc-bc579b880f39 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:39.679308 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9ed0e8f4-16cc-4e32-9abc-bc579b880f39 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:39.680466 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9ed0e8f4-16cc-4e32-9abc-bc579b880f39 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.162822 Jul 27 07:54:39.681325 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 319/652] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:39 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:40.703768 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f37f39ce-ea24-4372-8460-583ffad45a83 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:40.704309 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f37f39ce-ea24-4372-8460-583ffad45a83 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:40.711474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f37f39ce-ea24-4372-8460-583ffad45a83 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:40.711927 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f37f39ce-ea24-4372-8460-583ffad45a83 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:40.712697 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f37f39ce-ea24-4372-8460-583ffad45a83 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:40.713139 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f37f39ce-ea24-4372-8460-583ffad45a83 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:40.844183 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f37f39ce-ea24-4372-8460-583ffad45a83 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:40.853939 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f37f39ce-ea24-4372-8460-583ffad45a83 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:40.855547 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f37f39ce-ea24-4372-8460-583ffad45a83 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:40.856717 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f37f39ce-ea24-4372-8460-583ffad45a83 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.156931 Jul 27 07:54:40.857272 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 334/653] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:40 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:41.878806 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-03d75eeb-8f6a-4424-9e0a-6dcc3aaa2114 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:41.879708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-03d75eeb-8f6a-4424-9e0a-6dcc3aaa2114 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:41.887946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-03d75eeb-8f6a-4424-9e0a-6dcc3aaa2114 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:41.888479 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-03d75eeb-8f6a-4424-9e0a-6dcc3aaa2114 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:41.889404 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-03d75eeb-8f6a-4424-9e0a-6dcc3aaa2114 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:41.889897 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-03d75eeb-8f6a-4424-9e0a-6dcc3aaa2114 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:42.028647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-03d75eeb-8f6a-4424-9e0a-6dcc3aaa2114 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:42.030742 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:42.040735 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-03d75eeb-8f6a-4424-9e0a-6dcc3aaa2114 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:42.042607 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-03d75eeb-8f6a-4424-9e0a-6dcc3aaa2114 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:42.046747 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-03d75eeb-8f6a-4424-9e0a-6dcc3aaa2114 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.169594 Jul 27 07:54:42.062736 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 320/654] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:41 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:43.069990 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2105e4d8-51f4-407b-b705-e041e9172483 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:43.070597 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2105e4d8-51f4-407b-b705-e041e9172483 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:43.077310 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2105e4d8-51f4-407b-b705-e041e9172483 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:43.077765 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2105e4d8-51f4-407b-b705-e041e9172483 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:43.078536 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2105e4d8-51f4-407b-b705-e041e9172483 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:43.079013 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2105e4d8-51f4-407b-b705-e041e9172483 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:43.226740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2105e4d8-51f4-407b-b705-e041e9172483 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:43.236175 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2105e4d8-51f4-407b-b705-e041e9172483 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:43.237688 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2105e4d8-51f4-407b-b705-e041e9172483 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:43.238869 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2105e4d8-51f4-407b-b705-e041e9172483 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.173097 Jul 27 07:54:43.239458 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 335/655] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:43 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:44.262275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-76018c37-30d9-4b9a-99aa-88f07f213301 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:44.262936 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-76018c37-30d9-4b9a-99aa-88f07f213301 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:44.270426 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-76018c37-30d9-4b9a-99aa-88f07f213301 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:44.270873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-76018c37-30d9-4b9a-99aa-88f07f213301 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:44.271782 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-76018c37-30d9-4b9a-99aa-88f07f213301 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:44.272222 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-76018c37-30d9-4b9a-99aa-88f07f213301 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:44.418910 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-76018c37-30d9-4b9a-99aa-88f07f213301 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:44.432057 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-76018c37-30d9-4b9a-99aa-88f07f213301 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:44.433634 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-76018c37-30d9-4b9a-99aa-88f07f213301 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:44.434873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-76018c37-30d9-4b9a-99aa-88f07f213301 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.176702 Jul 27 07:54:44.435599 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 321/656] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:44 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:45.457555 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-30077f4a-f962-4bc5-9888-c1b770b62ecb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:45.458154 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-30077f4a-f962-4bc5-9888-c1b770b62ecb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:45.476953 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30077f4a-f962-4bc5-9888-c1b770b62ecb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:45.477319 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30077f4a-f962-4bc5-9888-c1b770b62ecb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:45.478117 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30077f4a-f962-4bc5-9888-c1b770b62ecb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:45.478613 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30077f4a-f962-4bc5-9888-c1b770b62ecb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:45.640850 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-30077f4a-f962-4bc5-9888-c1b770b62ecb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:45.651896 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-30077f4a-f962-4bc5-9888-c1b770b62ecb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:45.653426 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-30077f4a-f962-4bc5-9888-c1b770b62ecb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:45.654629 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-30077f4a-f962-4bc5-9888-c1b770b62ecb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.201012 Jul 27 07:54:45.655989 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 336/657] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:45 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:46.678289 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0275f99a-b981-44b3-a407-403954571e03 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:46.678916 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0275f99a-b981-44b3-a407-403954571e03 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:46.685445 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0275f99a-b981-44b3-a407-403954571e03 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:46.685903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0275f99a-b981-44b3-a407-403954571e03 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:46.686676 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0275f99a-b981-44b3-a407-403954571e03 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:46.687152 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0275f99a-b981-44b3-a407-403954571e03 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:46.823430 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0275f99a-b981-44b3-a407-403954571e03 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:46.831988 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0275f99a-b981-44b3-a407-403954571e03 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:46.833564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0275f99a-b981-44b3-a407-403954571e03 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:46.835429 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0275f99a-b981-44b3-a407-403954571e03 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.161222 Jul 27 07:54:46.835888 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 322/658] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:46 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:47.859801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ffc8074e-0050-4879-8e56-5158f7b65fc3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:47.860522 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ffc8074e-0050-4879-8e56-5158f7b65fc3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:47.868071 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ffc8074e-0050-4879-8e56-5158f7b65fc3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:47.868518 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ffc8074e-0050-4879-8e56-5158f7b65fc3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:47.869312 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ffc8074e-0050-4879-8e56-5158f7b65fc3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:47.869743 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ffc8074e-0050-4879-8e56-5158f7b65fc3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:48.021433 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ffc8074e-0050-4879-8e56-5158f7b65fc3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:48.031786 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ffc8074e-0050-4879-8e56-5158f7b65fc3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:48.033293 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ffc8074e-0050-4879-8e56-5158f7b65fc3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:48.034447 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ffc8074e-0050-4879-8e56-5158f7b65fc3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.178607 Jul 27 07:54:48.035033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 337/659] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:47 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:48.448297 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1356e966-a256-4d39-8b27-b82c079e1352 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-819000751", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-361390635", "security_groups": [{"name": "tempest-secgroup-smoke-234159808"}], "networks": [{"uuid": "6dd1f242-7297-4103-a1ef-c555065ed51e"}], "block_device_mapping_v2": [{"uuid": "d828318a-019a-41e9-b8c8-25f64d826a15", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:54:48.562390 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.network.neutron [None req-1356e966-a256-4d39-8b27-b82c079e1352 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] validate_networks() for [('6dd1f242-7297-4103-a1ef-c555065ed51e', None, None, None, None, None)] {{(pid=117779) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:54:48.994389 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-1356e966-a256-4d39-8b27-b82c079e1352 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Flavor limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:54:48.994830 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-1356e966-a256-4d39-8b27-b82c079e1352 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Image limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:54:48.995357 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-1356e966-a256-4d39-8b27-b82c079e1352 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Flavor pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:54:48.995766 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-1356e966-a256-4d39-8b27-b82c079e1352 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Image pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:54:48.996175 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-1356e966-a256-4d39-8b27-b82c079e1352 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:54:49.005160 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1356e966-a256-4d39-8b27-b82c079e1352 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:49.005614 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1356e966-a256-4d39-8b27-b82c079e1352 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:49.007030 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1356e966-a256-4d39-8b27-b82c079e1352 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:49.007469 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1356e966-a256-4d39-8b27-b82c079e1352 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:49.024919 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-1356e966-a256-4d39-8b27-b82c079e1352 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Getting quotas for project d312b027f97e482d82eea4bdd7bb3166. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:54:49.029125 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-1356e966-a256-4d39-8b27-b82c079e1352 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Getting quotas for user d93f5d182474439bb6ea1d8b70f39b2b and project d312b027f97e482d82eea4bdd7bb3166. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:54:49.058240 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-14f14586-0872-4be5-b4bf-6b9c38fa0b2b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:49.058992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-14f14586-0872-4be5-b4bf-6b9c38fa0b2b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:49.065487 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14f14586-0872-4be5-b4bf-6b9c38fa0b2b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:49.069532 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14f14586-0872-4be5-b4bf-6b9c38fa0b2b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:49.070483 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14f14586-0872-4be5-b4bf-6b9c38fa0b2b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:49.071012 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14f14586-0872-4be5-b4bf-6b9c38fa0b2b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:49.092115 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1356e966-a256-4d39-8b27-b82c079e1352 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Going to run 1 instances... {{(pid=117779) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:54:49.094365 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1356e966-a256-4d39-8b27-b82c079e1352 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d828318a-019a-41e9-b8c8-25f64d826a15',volume_size=None,volume_type=None)] {{(pid=117779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:54:49.227243 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-14f14586-0872-4be5-b4bf-6b9c38fa0b2b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:49.238202 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-14f14586-0872-4be5-b4bf-6b9c38fa0b2b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:49.239861 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-14f14586-0872-4be5-b4bf-6b9c38fa0b2b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:49.241627 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-14f14586-0872-4be5-b4bf-6b9c38fa0b2b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.187323 Jul 27 07:54:49.242192 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 338/660] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:49 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:54:49.254968 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1356e966-a256-4d39-8b27-b82c079e1352 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.810354 Jul 27 07:54:49.255671 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 323/661] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 07:54:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 07:54:49.266268 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2a6a7ad6-d61f-4435-9b98-9f83f1324557 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:49.266879 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2a6a7ad6-d61f-4435-9b98-9f83f1324557 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:49.327538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2a6a7ad6-d61f-4435-9b98-9f83f1324557 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:49.343196 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2a6a7ad6-d61f-4435-9b98-9f83f1324557 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1087 microversion: 2.1 time: 0.080463 Jul 27 07:54:49.344164 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 339/662] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:49 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1087 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:50.365843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-198a8503-87ae-4c83-a9f0-0e2baa4e2e7a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:50.367423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-198a8503-87ae-4c83-a9f0-0e2baa4e2e7a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:50.375694 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-198a8503-87ae-4c83-a9f0-0e2baa4e2e7a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:50.375919 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-198a8503-87ae-4c83-a9f0-0e2baa4e2e7a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:50.377003 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-198a8503-87ae-4c83-a9f0-0e2baa4e2e7a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:50.377443 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-198a8503-87ae-4c83-a9f0-0e2baa4e2e7a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:50.380362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2fe909df-1d2a-4175-882b-30701f381c3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:50.381557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2fe909df-1d2a-4175-882b-30701f381c3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:50.387617 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2fe909df-1d2a-4175-882b-30701f381c3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:50.388068 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2fe909df-1d2a-4175-882b-30701f381c3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:50.389125 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2fe909df-1d2a-4175-882b-30701f381c3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:50.389570 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2fe909df-1d2a-4175-882b-30701f381c3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:50.453295 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-198a8503-87ae-4c83-a9f0-0e2baa4e2e7a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:50.462699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-198a8503-87ae-4c83-a9f0-0e2baa4e2e7a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1137 microversion: 2.1 time: 0.101036 Jul 27 07:54:50.464085 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 340/663] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:50 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1137 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:54:50.469116 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4c5532a0-1294-45f5-958c-02f2d44d1769 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:54:50.471725 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4c5532a0-1294-45f5-958c-02f2d44d1769 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:50.478693 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4c5532a0-1294-45f5-958c-02f2d44d1769 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:50.479178 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4c5532a0-1294-45f5-958c-02f2d44d1769 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:50.479958 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4c5532a0-1294-45f5-958c-02f2d44d1769 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:50.480392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4c5532a0-1294-45f5-958c-02f2d44d1769 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:50.526744 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:50.558134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4c5532a0-1294-45f5-958c-02f2d44d1769 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "POST /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332/action" status: 202 len: 0 microversion: 2.1 time: 0.092628 Jul 27 07:54:50.563371 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 341/664] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Jul 27 07:54:50 2022] POST /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 07:54:50.569391 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9307c7a5-f48d-4b54-b5d5-533f0a3a4586 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:50.570519 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2fe909df-1d2a-4175-882b-30701f381c3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:50.571728 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9307c7a5-f48d-4b54-b5d5-533f0a3a4586 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:50.579510 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9307c7a5-f48d-4b54-b5d5-533f0a3a4586 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:50.580208 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9307c7a5-f48d-4b54-b5d5-533f0a3a4586 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:50.581432 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9307c7a5-f48d-4b54-b5d5-533f0a3a4586 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:50.581900 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9307c7a5-f48d-4b54-b5d5-533f0a3a4586 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:50.584897 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2fe909df-1d2a-4175-882b-30701f381c3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:50.590852 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2fe909df-1d2a-4175-882b-30701f381c3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:50.592555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2fe909df-1d2a-4175-882b-30701f381c3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.330981 Jul 27 07:54:50.606380 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 324/665] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:50 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:50.743918 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9307c7a5-f48d-4b54-b5d5-533f0a3a4586 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:50.751863 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9307c7a5-f48d-4b54-b5d5-533f0a3a4586 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1750 microversion: 2.1 time: 0.186980 Jul 27 07:54:50.752429 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 342/666] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:50 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1750 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:51.484709 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e8c15417-fe99-45c9-86d8-2800fc6f67ea tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:51.485312 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e8c15417-fe99-45c9-86d8-2800fc6f67ea tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:51.492639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e8c15417-fe99-45c9-86d8-2800fc6f67ea tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:51.493077 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e8c15417-fe99-45c9-86d8-2800fc6f67ea tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:51.493848 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e8c15417-fe99-45c9-86d8-2800fc6f67ea tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:51.494265 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e8c15417-fe99-45c9-86d8-2800fc6f67ea tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:51.554809 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e8c15417-fe99-45c9-86d8-2800fc6f67ea tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:51.562393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e8c15417-fe99-45c9-86d8-2800fc6f67ea tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1137 microversion: 2.1 time: 0.081534 Jul 27 07:54:51.562977 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 325/667] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:51 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1137 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:51.617383 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fb527266-1edb-461b-8e5f-774255ddac7c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:51.618013 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fb527266-1edb-461b-8e5f-774255ddac7c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:51.624659 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb527266-1edb-461b-8e5f-774255ddac7c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:51.625119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb527266-1edb-461b-8e5f-774255ddac7c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:51.625908 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb527266-1edb-461b-8e5f-774255ddac7c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:51.626339 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb527266-1edb-461b-8e5f-774255ddac7c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:51.753874 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fb527266-1edb-461b-8e5f-774255ddac7c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:51.762389 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fb527266-1edb-461b-8e5f-774255ddac7c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:51.763929 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fb527266-1edb-461b-8e5f-774255ddac7c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:51.765087 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fb527266-1edb-461b-8e5f-774255ddac7c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.152333 Jul 27 07:54:51.765665 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 343/668] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:51 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:51.773081 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7a9d857c-251e-4abf-8d9a-1c859cba4197 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:51.773697 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-7a9d857c-251e-4abf-8d9a-1c859cba4197 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:51.779805 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7a9d857c-251e-4abf-8d9a-1c859cba4197 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:51.780266 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7a9d857c-251e-4abf-8d9a-1c859cba4197 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:51.781032 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7a9d857c-251e-4abf-8d9a-1c859cba4197 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:51.781500 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7a9d857c-251e-4abf-8d9a-1c859cba4197 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:51.926044 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7a9d857c-251e-4abf-8d9a-1c859cba4197 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:51.934060 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7a9d857c-251e-4abf-8d9a-1c859cba4197 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1750 microversion: 2.1 time: 0.164965 Jul 27 07:54:51.934625 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 326/669] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:51 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:52.583580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-633a7df2-8f30-40e0-81d4-ef32ad335fc9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:52.584700 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-633a7df2-8f30-40e0-81d4-ef32ad335fc9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:52.591039 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-633a7df2-8f30-40e0-81d4-ef32ad335fc9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:52.591492 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-633a7df2-8f30-40e0-81d4-ef32ad335fc9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:52.592258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-633a7df2-8f30-40e0-81d4-ef32ad335fc9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:52.592695 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-633a7df2-8f30-40e0-81d4-ef32ad335fc9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:52.656165 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-633a7df2-8f30-40e0-81d4-ef32ad335fc9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:52.664256 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-633a7df2-8f30-40e0-81d4-ef32ad335fc9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1137 microversion: 2.1 time: 0.084564 Jul 27 07:54:52.664824 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 344/670] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:52 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:52.790228 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b7005a1d-364b-4c28-95ba-cf4af17c6e1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:52.790861 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b7005a1d-364b-4c28-95ba-cf4af17c6e1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:52.797333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b7005a1d-364b-4c28-95ba-cf4af17c6e1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:52.797803 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b7005a1d-364b-4c28-95ba-cf4af17c6e1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:52.798618 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b7005a1d-364b-4c28-95ba-cf4af17c6e1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:52.799079 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b7005a1d-364b-4c28-95ba-cf4af17c6e1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:52.931602 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b7005a1d-364b-4c28-95ba-cf4af17c6e1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:52.939977 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b7005a1d-364b-4c28-95ba-cf4af17c6e1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:52.941476 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b7005a1d-364b-4c28-95ba-cf4af17c6e1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:52.942688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b7005a1d-364b-4c28-95ba-cf4af17c6e1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.156900 Jul 27 07:54:52.943324 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 327/671] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:52 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:52.955144 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8b45dea3-b2b4-4163-a033-6a6d3454f642 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:52.955758 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8b45dea3-b2b4-4163-a033-6a6d3454f642 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:52.962216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8b45dea3-b2b4-4163-a033-6a6d3454f642 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:52.962658 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8b45dea3-b2b4-4163-a033-6a6d3454f642 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:52.963456 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8b45dea3-b2b4-4163-a033-6a6d3454f642 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:52.963891 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8b45dea3-b2b4-4163-a033-6a6d3454f642 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:53.115404 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8b45dea3-b2b4-4163-a033-6a6d3454f642 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:53.123465 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8b45dea3-b2b4-4163-a033-6a6d3454f642 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1750 microversion: 2.1 time: 0.172178 Jul 27 07:54:53.124025 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 345/672] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:52 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:53.685220 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f7080e71-356e-49e4-9aaf-4af89941c69f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:53.685741 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f7080e71-356e-49e4-9aaf-4af89941c69f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:53.691799 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f7080e71-356e-49e4-9aaf-4af89941c69f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:53.692241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f7080e71-356e-49e4-9aaf-4af89941c69f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:53.692988 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f7080e71-356e-49e4-9aaf-4af89941c69f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:53.694040 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f7080e71-356e-49e4-9aaf-4af89941c69f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:53.753577 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f7080e71-356e-49e4-9aaf-4af89941c69f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:53.761092 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f7080e71-356e-49e4-9aaf-4af89941c69f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1137 microversion: 2.1 time: 0.079809 Jul 27 07:54:53.761649 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 328/673] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:53 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1137 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:53.965867 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1c94e822-fb2e-497c-91a6-cedf9756be3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:53.966422 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1c94e822-fb2e-497c-91a6-cedf9756be3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:53.973287 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1c94e822-fb2e-497c-91a6-cedf9756be3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:53.973738 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1c94e822-fb2e-497c-91a6-cedf9756be3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:53.975511 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1c94e822-fb2e-497c-91a6-cedf9756be3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:53.975660 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1c94e822-fb2e-497c-91a6-cedf9756be3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:54.119844 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1c94e822-fb2e-497c-91a6-cedf9756be3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:54.128414 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1c94e822-fb2e-497c-91a6-cedf9756be3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:54.129962 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1c94e822-fb2e-497c-91a6-cedf9756be3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:54.131756 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1c94e822-fb2e-497c-91a6-cedf9756be3b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.169566 Jul 27 07:54:54.132312 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 346/674] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:53 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:54.144988 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1c3127f8-6137-431e-9429-cb18c4b58ecf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:54.145602 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1c3127f8-6137-431e-9429-cb18c4b58ecf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:54.152131 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1c3127f8-6137-431e-9429-cb18c4b58ecf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:54.152577 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1c3127f8-6137-431e-9429-cb18c4b58ecf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:54.153341 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1c3127f8-6137-431e-9429-cb18c4b58ecf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:54.153773 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1c3127f8-6137-431e-9429-cb18c4b58ecf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:54.294978 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1c3127f8-6137-431e-9429-cb18c4b58ecf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:54.303811 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1c3127f8-6137-431e-9429-cb18c4b58ecf tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1750 microversion: 2.1 time: 0.162691 Jul 27 07:54:54.304389 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 329/675] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:54 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:54.782822 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fd93da95-5fd8-4856-96b3-4f7e21970ca6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:54.783711 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fd93da95-5fd8-4856-96b3-4f7e21970ca6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:54.790632 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd93da95-5fd8-4856-96b3-4f7e21970ca6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:54.791127 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd93da95-5fd8-4856-96b3-4f7e21970ca6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:54.791899 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd93da95-5fd8-4856-96b3-4f7e21970ca6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:54.792346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd93da95-5fd8-4856-96b3-4f7e21970ca6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:54.856773 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fd93da95-5fd8-4856-96b3-4f7e21970ca6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:54.864314 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fd93da95-5fd8-4856-96b3-4f7e21970ca6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1129 microversion: 2.1 time: 0.085917 Jul 27 07:54:54.864873 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 347/676] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:54 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1129 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:55.154644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-3ab54f6f-6139-4920-a61b-fb5d802e34ef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:55.155326 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-3ab54f6f-6139-4920-a61b-fb5d802e34ef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:55.161872 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3ab54f6f-6139-4920-a61b-fb5d802e34ef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:55.162316 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3ab54f6f-6139-4920-a61b-fb5d802e34ef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:55.163113 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3ab54f6f-6139-4920-a61b-fb5d802e34ef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:55.163546 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3ab54f6f-6139-4920-a61b-fb5d802e34ef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:55.297435 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3ab54f6f-6139-4920-a61b-fb5d802e34ef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:55.306323 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3ab54f6f-6139-4920-a61b-fb5d802e34ef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:55.307875 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3ab54f6f-6139-4920-a61b-fb5d802e34ef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:55.309058 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-3ab54f6f-6139-4920-a61b-fb5d802e34ef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.158333 Jul 27 07:54:55.309690 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 330/677] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:55 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:55.325191 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-669de5a8-384f-487f-adc5-055d8af6c5ac tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:55.325933 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-669de5a8-384f-487f-adc5-055d8af6c5ac tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:55.332607 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-669de5a8-384f-487f-adc5-055d8af6c5ac tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:55.333058 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-669de5a8-384f-487f-adc5-055d8af6c5ac tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:55.334474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-669de5a8-384f-487f-adc5-055d8af6c5ac tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:55.334937 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-669de5a8-384f-487f-adc5-055d8af6c5ac tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:55.480876 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-669de5a8-384f-487f-adc5-055d8af6c5ac tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:55.489764 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-669de5a8-384f-487f-adc5-055d8af6c5ac tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1750 microversion: 2.1 time: 0.168403 Jul 27 07:54:55.490395 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 348/678] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:55 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1750 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:55.885365 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c7b551d4-5a2c-4973-a206-5172c182aa36 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:55.885988 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c7b551d4-5a2c-4973-a206-5172c182aa36 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:55.892903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c7b551d4-5a2c-4973-a206-5172c182aa36 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:55.893418 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c7b551d4-5a2c-4973-a206-5172c182aa36 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:55.894229 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c7b551d4-5a2c-4973-a206-5172c182aa36 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:55.894702 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c7b551d4-5a2c-4973-a206-5172c182aa36 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:55.967229 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c7b551d4-5a2c-4973-a206-5172c182aa36 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:55.976452 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c7b551d4-5a2c-4973-a206-5172c182aa36 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1129 microversion: 2.1 time: 0.095583 Jul 27 07:54:55.977671 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 331/679] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:55 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1129 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:56.332447 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2f11b934-e6bf-4305-9144-900e449b92bc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:56.334456 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2f11b934-e6bf-4305-9144-900e449b92bc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:56.341577 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2f11b934-e6bf-4305-9144-900e449b92bc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:56.342054 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2f11b934-e6bf-4305-9144-900e449b92bc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:56.342806 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2f11b934-e6bf-4305-9144-900e449b92bc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:56.343403 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2f11b934-e6bf-4305-9144-900e449b92bc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:56.481298 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2f11b934-e6bf-4305-9144-900e449b92bc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:56.489792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2f11b934-e6bf-4305-9144-900e449b92bc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:56.491517 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2f11b934-e6bf-4305-9144-900e449b92bc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:56.492986 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2f11b934-e6bf-4305-9144-900e449b92bc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.164598 Jul 27 07:54:56.493546 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 349/680] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:56 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:56.512157 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-22bb2558-0c2f-4985-8d11-58fe4dbdddab tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:56.512825 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-22bb2558-0c2f-4985-8d11-58fe4dbdddab tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:56.519718 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-22bb2558-0c2f-4985-8d11-58fe4dbdddab tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:56.520380 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-22bb2558-0c2f-4985-8d11-58fe4dbdddab tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:56.520938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-22bb2558-0c2f-4985-8d11-58fe4dbdddab tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:56.521870 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-22bb2558-0c2f-4985-8d11-58fe4dbdddab tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:56.996964 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-987b80b4-a386-484b-89f3-5a8258816921 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:56.997581 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-987b80b4-a386-484b-89f3-5a8258816921 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:57.004285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-987b80b4-a386-484b-89f3-5a8258816921 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:57.004737 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-987b80b4-a386-484b-89f3-5a8258816921 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:57.006009 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-987b80b4-a386-484b-89f3-5a8258816921 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:57.006447 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-987b80b4-a386-484b-89f3-5a8258816921 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:57.064581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-22bb2558-0c2f-4985-8d11-58fe4dbdddab tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:57.073495 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-22bb2558-0c2f-4985-8d11-58fe4dbdddab tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1750 microversion: 2.1 time: 0.565135 Jul 27 07:54:57.074079 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 332/681] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:56 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1750 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:57.080965 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-987b80b4-a386-484b-89f3-5a8258816921 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:57.089349 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-987b80b4-a386-484b-89f3-5a8258816921 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1203 microversion: 2.1 time: 0.096474 Jul 27 07:54:57.089923 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 350/682] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:56 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1203 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:57.515683 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-3d840dd3-9dbc-48ec-87bc-dfa4f4c80d27 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:57.516254 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-3d840dd3-9dbc-48ec-87bc-dfa4f4c80d27 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:57.518436 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:57.523553 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3d840dd3-9dbc-48ec-87bc-dfa4f4c80d27 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:57.523997 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3d840dd3-9dbc-48ec-87bc-dfa4f4c80d27 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:57.524756 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3d840dd3-9dbc-48ec-87bc-dfa4f4c80d27 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:57.525183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3d840dd3-9dbc-48ec-87bc-dfa4f4c80d27 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:57.720487 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3d840dd3-9dbc-48ec-87bc-dfa4f4c80d27 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:57.729826 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3d840dd3-9dbc-48ec-87bc-dfa4f4c80d27 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:57.731368 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3d840dd3-9dbc-48ec-87bc-dfa4f4c80d27 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:57.732525 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-3d840dd3-9dbc-48ec-87bc-dfa4f4c80d27 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.220816 Jul 27 07:54:57.733073 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 333/683] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:57 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:58.096846 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b31b24d1-f95c-4dcd-91da-782e3f1af6f7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:58.097470 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b31b24d1-f95c-4dcd-91da-782e3f1af6f7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:58.104472 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b31b24d1-f95c-4dcd-91da-782e3f1af6f7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:58.104917 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b31b24d1-f95c-4dcd-91da-782e3f1af6f7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:58.105690 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b31b24d1-f95c-4dcd-91da-782e3f1af6f7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:58.106213 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b31b24d1-f95c-4dcd-91da-782e3f1af6f7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:58.111188 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0087a20e-1b5d-4fd9-8f4c-12f554d7e200 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:58.111807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0087a20e-1b5d-4fd9-8f4c-12f554d7e200 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:58.117845 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0087a20e-1b5d-4fd9-8f4c-12f554d7e200 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:58.118286 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0087a20e-1b5d-4fd9-8f4c-12f554d7e200 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:58.119097 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0087a20e-1b5d-4fd9-8f4c-12f554d7e200 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:58.119708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0087a20e-1b5d-4fd9-8f4c-12f554d7e200 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:58.259921 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b31b24d1-f95c-4dcd-91da-782e3f1af6f7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:58.268339 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b31b24d1-f95c-4dcd-91da-782e3f1af6f7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1755 microversion: 2.1 time: 0.175383 Jul 27 07:54:58.269016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 351/684] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:58 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:58.345493 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0087a20e-1b5d-4fd9-8f4c-12f554d7e200 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:58.354446 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0087a20e-1b5d-4fd9-8f4c-12f554d7e200 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1258 microversion: 2.1 time: 0.247087 Jul 27 07:54:58.355199 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 334/685] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:58 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1258 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:58.570325 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-626fc312-78fe-47f2-bfe0-3e3637ab12c0 req-9f884b45-ef9d-454b-a2ab-8f9698c4cf63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0b0841-bd90-4361-9866-e51a7c5db994", "tag": "6eaca3f7-b87d-4766-ad60-73f678ccc493"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:54:58.582634 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-626fc312-78fe-47f2-bfe0-3e3637ab12c0 req-9f884b45-ef9d-454b-a2ab-8f9698c4cf63 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:58.583125 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-626fc312-78fe-47f2-bfe0-3e3637ab12c0 req-9f884b45-ef9d-454b-a2ab-8f9698c4cf63 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:58.598320 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-626fc312-78fe-47f2-bfe0-3e3637ab12c0 req-9f884b45-ef9d-454b-a2ab-8f9698c4cf63 service nova] Creating event network-changed:6eaca3f7-b87d-4766-ad60-73f678ccc493 for instance fb0b0841-bd90-4361-9866-e51a7c5db994 on hv-cinder-82549 Jul 27 07:54:58.604643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-626fc312-78fe-47f2-bfe0-3e3637ab12c0 req-9f884b45-ef9d-454b-a2ab-8f9698c4cf63 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038343 Jul 27 07:54:58.605341 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 352/686] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:54:58.756274 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-8e552b78-cb58-4af6-b0ff-c5e93d91e926 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:58.756874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-8e552b78-cb58-4af6-b0ff-c5e93d91e926 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:58.763283 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8e552b78-cb58-4af6-b0ff-c5e93d91e926 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:58.763730 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8e552b78-cb58-4af6-b0ff-c5e93d91e926 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:58.764494 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8e552b78-cb58-4af6-b0ff-c5e93d91e926 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:58.764918 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8e552b78-cb58-4af6-b0ff-c5e93d91e926 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:58.981613 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8e552b78-cb58-4af6-b0ff-c5e93d91e926 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:58.990158 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8e552b78-cb58-4af6-b0ff-c5e93d91e926 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:58.991685 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8e552b78-cb58-4af6-b0ff-c5e93d91e926 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:58.992837 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-8e552b78-cb58-4af6-b0ff-c5e93d91e926 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.240442 Jul 27 07:54:58.993396 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 335/687] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:54:58 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:54:59.291888 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8dbacd36-4447-436b-abed-cad53919671e tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:59.292497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8dbacd36-4447-436b-abed-cad53919671e tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:59.299102 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8dbacd36-4447-436b-abed-cad53919671e tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:59.299556 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8dbacd36-4447-436b-abed-cad53919671e tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:59.300319 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8dbacd36-4447-436b-abed-cad53919671e tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:59.300760 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8dbacd36-4447-436b-abed-cad53919671e tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:59.339419 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:59.375556 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-50d597ec-f377-4d8d-a094-81b01e98f72f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:54:59.376161 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-50d597ec-f377-4d8d-a094-81b01e98f72f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:54:59.378050 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=2 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:59.378719 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=6 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:54:59.385401 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-50d597ec-f377-4d8d-a094-81b01e98f72f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:59.385850 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-50d597ec-f377-4d8d-a094-81b01e98f72f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:59.386618 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-50d597ec-f377-4d8d-a094-81b01e98f72f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:54:59.387135 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-50d597ec-f377-4d8d-a094-81b01e98f72f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:54:59.452189 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8dbacd36-4447-436b-abed-cad53919671e tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:59.460536 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8dbacd36-4447-436b-abed-cad53919671e tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1755 microversion: 2.1 time: 0.173613 Jul 27 07:54:59.461110 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 353/688] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:59 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:54:59.522764 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-50d597ec-f377-4d8d-a094-81b01e98f72f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:54:59.530293 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-50d597ec-f377-4d8d-a094-81b01e98f72f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1258 microversion: 2.1 time: 0.158626 Jul 27 07:54:59.530860 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 336/689] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:54:59 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:55:00.015683 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9bee5b97-5d5c-4c65-8e21-c5616d0cf6c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:00.016198 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9bee5b97-5d5c-4c65-8e21-c5616d0cf6c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:00.022490 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9bee5b97-5d5c-4c65-8e21-c5616d0cf6c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:00.022976 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9bee5b97-5d5c-4c65-8e21-c5616d0cf6c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:00.023748 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9bee5b97-5d5c-4c65-8e21-c5616d0cf6c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:00.024188 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9bee5b97-5d5c-4c65-8e21-c5616d0cf6c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:00.166858 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9bee5b97-5d5c-4c65-8e21-c5616d0cf6c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:00.175468 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9bee5b97-5d5c-4c65-8e21-c5616d0cf6c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:00.176986 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9bee5b97-5d5c-4c65-8e21-c5616d0cf6c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:00.178139 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9bee5b97-5d5c-4c65-8e21-c5616d0cf6c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.166443 Jul 27 07:55:00.178687 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 354/690] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:55:00 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:55:00.481586 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-44ad88e8-3c06-4efd-832b-ef19de4c3567 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:00.482192 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-44ad88e8-3c06-4efd-832b-ef19de4c3567 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:00.488872 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-44ad88e8-3c06-4efd-832b-ef19de4c3567 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:00.489323 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-44ad88e8-3c06-4efd-832b-ef19de4c3567 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:00.490718 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-44ad88e8-3c06-4efd-832b-ef19de4c3567 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:00.491195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-44ad88e8-3c06-4efd-832b-ef19de4c3567 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:00.551549 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-04815eda-3445-43a1-8aca-b8c51f5cb037 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:00.553026 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-04815eda-3445-43a1-8aca-b8c51f5cb037 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:00.556808 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=56 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:55:00.561598 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-04815eda-3445-43a1-8aca-b8c51f5cb037 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:00.562051 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-04815eda-3445-43a1-8aca-b8c51f5cb037 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:00.562840 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-04815eda-3445-43a1-8aca-b8c51f5cb037 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:00.563355 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-04815eda-3445-43a1-8aca-b8c51f5cb037 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:00.697925 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-04815eda-3445-43a1-8aca-b8c51f5cb037 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:00.705625 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-04815eda-3445-43a1-8aca-b8c51f5cb037 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1258 microversion: 2.1 time: 0.158066 Jul 27 07:55:00.706272 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 355/691] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:00 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:55:00.736135 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-44ad88e8-3c06-4efd-832b-ef19de4c3567 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:00.744271 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-44ad88e8-3c06-4efd-832b-ef19de4c3567 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1755 microversion: 2.1 time: 0.266529 Jul 27 07:55:00.744847 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 337/692] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:00 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1755 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:01.201140 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8ce3a60c-99d4-493a-814c-752c515cb02a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:01.201674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8ce3a60c-99d4-493a-814c-752c515cb02a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:01.207843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8ce3a60c-99d4-493a-814c-752c515cb02a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:01.208284 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8ce3a60c-99d4-493a-814c-752c515cb02a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:01.209049 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8ce3a60c-99d4-493a-814c-752c515cb02a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:01.209531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8ce3a60c-99d4-493a-814c-752c515cb02a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:01.348333 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8ce3a60c-99d4-493a-814c-752c515cb02a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:01.357334 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8ce3a60c-99d4-493a-814c-752c515cb02a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:01.358832 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8ce3a60c-99d4-493a-814c-752c515cb02a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:01.360011 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8ce3a60c-99d4-493a-814c-752c515cb02a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.163013 Jul 27 07:55:01.360630 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 356/693] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:55:01 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:55:01.728395 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-89f6e655-20f3-4a1d-bf5e-089176a284d6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:01.729008 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-89f6e655-20f3-4a1d-bf5e-089176a284d6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:01.736128 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-89f6e655-20f3-4a1d-bf5e-089176a284d6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:01.736622 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-89f6e655-20f3-4a1d-bf5e-089176a284d6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:01.737393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-89f6e655-20f3-4a1d-bf5e-089176a284d6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:01.737826 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-89f6e655-20f3-4a1d-bf5e-089176a284d6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:01.740411 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=100 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:55:01.765485 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ee1a9cc2-17e0-4cb0-88ae-f44e9c9efa30 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:01.766086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ee1a9cc2-17e0-4cb0-88ae-f44e9c9efa30 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:01.773154 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ee1a9cc2-17e0-4cb0-88ae-f44e9c9efa30 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:01.773602 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ee1a9cc2-17e0-4cb0-88ae-f44e9c9efa30 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:01.774958 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ee1a9cc2-17e0-4cb0-88ae-f44e9c9efa30 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:01.774958 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ee1a9cc2-17e0-4cb0-88ae-f44e9c9efa30 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:01.888624 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-89f6e655-20f3-4a1d-bf5e-089176a284d6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:01.897094 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-89f6e655-20f3-4a1d-bf5e-089176a284d6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1258 microversion: 2.1 time: 0.173320 Jul 27 07:55:01.908289 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 338/694] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:01 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1258 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:01.920061 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ee1a9cc2-17e0-4cb0-88ae-f44e9c9efa30 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:01.928037 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ee1a9cc2-17e0-4cb0-88ae-f44e9c9efa30 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1755 microversion: 2.1 time: 0.166339 Jul 27 07:55:01.928592 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 357/695] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:01 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:55:02.386116 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-de8a41a6-06a8-45fd-9be9-62c39d49eb89 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:02.386724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-de8a41a6-06a8-45fd-9be9-62c39d49eb89 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:02.392789 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-de8a41a6-06a8-45fd-9be9-62c39d49eb89 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:02.393228 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-de8a41a6-06a8-45fd-9be9-62c39d49eb89 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:02.393984 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-de8a41a6-06a8-45fd-9be9-62c39d49eb89 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:02.394412 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-de8a41a6-06a8-45fd-9be9-62c39d49eb89 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:02.522111 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-de8a41a6-06a8-45fd-9be9-62c39d49eb89 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:02.530540 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-de8a41a6-06a8-45fd-9be9-62c39d49eb89 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:02.532089 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-de8a41a6-06a8-45fd-9be9-62c39d49eb89 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:02.533242 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-de8a41a6-06a8-45fd-9be9-62c39d49eb89 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.152217 Jul 27 07:55:02.533806 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 339/696] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:55:02 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:55:02.917704 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fef160e3-70b7-4f89-a188-2e96515fee97 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:02.918311 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fef160e3-70b7-4f89-a188-2e96515fee97 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:02.924859 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fef160e3-70b7-4f89-a188-2e96515fee97 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:02.925306 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fef160e3-70b7-4f89-a188-2e96515fee97 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:02.926070 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fef160e3-70b7-4f89-a188-2e96515fee97 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:02.926503 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fef160e3-70b7-4f89-a188-2e96515fee97 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:02.944664 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:55:02.949201 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-59a65237-92fc-451f-bd07-1301f5cbbd8f tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:02.949811 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-59a65237-92fc-451f-bd07-1301f5cbbd8f tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:02.956507 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-59a65237-92fc-451f-bd07-1301f5cbbd8f tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:02.956949 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-59a65237-92fc-451f-bd07-1301f5cbbd8f tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:02.957708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-59a65237-92fc-451f-bd07-1301f5cbbd8f tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:02.958138 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-59a65237-92fc-451f-bd07-1301f5cbbd8f tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:03.064983 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fef160e3-70b7-4f89-a188-2e96515fee97 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:03.072574 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fef160e3-70b7-4f89-a188-2e96515fee97 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1258 microversion: 2.1 time: 0.158705 Jul 27 07:55:03.073137 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 358/697] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:02 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:03.103146 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-59a65237-92fc-451f-bd07-1301f5cbbd8f tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:03.111361 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-59a65237-92fc-451f-bd07-1301f5cbbd8f tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1755 microversion: 2.1 time: 0.166122 Jul 27 07:55:03.111921 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 340/698] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:02 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:55:03.558212 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a6fbcf49-09b4-4d23-8d61-61a0a888fc1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:03.559270 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a6fbcf49-09b4-4d23-8d61-61a0a888fc1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:03.565977 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a6fbcf49-09b4-4d23-8d61-61a0a888fc1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:03.566420 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a6fbcf49-09b4-4d23-8d61-61a0a888fc1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:03.567215 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a6fbcf49-09b4-4d23-8d61-61a0a888fc1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:03.567652 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a6fbcf49-09b4-4d23-8d61-61a0a888fc1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:03.698430 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a6fbcf49-09b4-4d23-8d61-61a0a888fc1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:03.707063 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a6fbcf49-09b4-4d23-8d61-61a0a888fc1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:03.708689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a6fbcf49-09b4-4d23-8d61-61a0a888fc1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:03.710076 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a6fbcf49-09b4-4d23-8d61-61a0a888fc1e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.157808 Jul 27 07:55:03.710739 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 359/699] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:55:03 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:55:04.094126 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a514ae7b-c6ed-40db-9020-b2b6de5ac014 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:04.094834 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a514ae7b-c6ed-40db-9020-b2b6de5ac014 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:04.102287 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a514ae7b-c6ed-40db-9020-b2b6de5ac014 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:04.102742 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a514ae7b-c6ed-40db-9020-b2b6de5ac014 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:04.103557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a514ae7b-c6ed-40db-9020-b2b6de5ac014 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:04.103992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a514ae7b-c6ed-40db-9020-b2b6de5ac014 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:04.132826 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-dc5bff16-7893-4709-b9bf-e30d5ada9a44 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:04.133439 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-dc5bff16-7893-4709-b9bf-e30d5ada9a44 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:04.140154 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dc5bff16-7893-4709-b9bf-e30d5ada9a44 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:04.140903 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dc5bff16-7893-4709-b9bf-e30d5ada9a44 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:04.141920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dc5bff16-7893-4709-b9bf-e30d5ada9a44 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:04.142355 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dc5bff16-7893-4709-b9bf-e30d5ada9a44 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:04.248856 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a514ae7b-c6ed-40db-9020-b2b6de5ac014 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:04.257576 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a514ae7b-c6ed-40db-9020-b2b6de5ac014 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1258 microversion: 2.1 time: 0.167203 Jul 27 07:55:04.258482 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 341/700] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:04 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:04.304245 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-dc5bff16-7893-4709-b9bf-e30d5ada9a44 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:04.312454 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-dc5bff16-7893-4709-b9bf-e30d5ada9a44 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1755 microversion: 2.1 time: 0.183444 Jul 27 07:55:04.313155 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 360/701] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:04 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:55:04.734543 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-11e2cda2-2dbf-42fe-82eb-b68be17e0a49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:04.735190 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-11e2cda2-2dbf-42fe-82eb-b68be17e0a49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:04.741734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-11e2cda2-2dbf-42fe-82eb-b68be17e0a49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:04.742188 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-11e2cda2-2dbf-42fe-82eb-b68be17e0a49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:04.742981 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-11e2cda2-2dbf-42fe-82eb-b68be17e0a49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:04.743423 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-11e2cda2-2dbf-42fe-82eb-b68be17e0a49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:04.875777 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-11e2cda2-2dbf-42fe-82eb-b68be17e0a49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:04.885144 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-11e2cda2-2dbf-42fe-82eb-b68be17e0a49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:04.886649 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-11e2cda2-2dbf-42fe-82eb-b68be17e0a49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:04.887840 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-11e2cda2-2dbf-42fe-82eb-b68be17e0a49 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.157334 Jul 27 07:55:04.888405 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 342/702] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:55:04 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:55:05.278352 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-09323055-4f60-40ae-a64c-8ea12eb5dffe tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:05.279003 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-09323055-4f60-40ae-a64c-8ea12eb5dffe tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:05.288295 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-09323055-4f60-40ae-a64c-8ea12eb5dffe tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:05.288803 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-09323055-4f60-40ae-a64c-8ea12eb5dffe tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:05.289733 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-09323055-4f60-40ae-a64c-8ea12eb5dffe tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:05.290343 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-09323055-4f60-40ae-a64c-8ea12eb5dffe tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:05.334290 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d12944e5-c4ca-4bd5-ad54-d60c8e48a816 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:05.335929 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d12944e5-c4ca-4bd5-ad54-d60c8e48a816 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:05.342369 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d12944e5-c4ca-4bd5-ad54-d60c8e48a816 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:05.342820 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d12944e5-c4ca-4bd5-ad54-d60c8e48a816 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:05.343651 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d12944e5-c4ca-4bd5-ad54-d60c8e48a816 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:05.344088 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d12944e5-c4ca-4bd5-ad54-d60c8e48a816 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:05.463814 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-09323055-4f60-40ae-a64c-8ea12eb5dffe tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:05.480560 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-09323055-4f60-40ae-a64c-8ea12eb5dffe tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1258 microversion: 2.1 time: 0.206079 Jul 27 07:55:05.481152 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 361/703] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:05 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1258 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:05.527210 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d12944e5-c4ca-4bd5-ad54-d60c8e48a816 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:05.535443 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d12944e5-c4ca-4bd5-ad54-d60c8e48a816 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1755 microversion: 2.1 time: 0.205509 Jul 27 07:55:05.536209 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 343/704] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:05 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1755 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:05.909546 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d2b8c1bb-570d-4baf-a4f0-12eac51fe0c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:05.910143 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d2b8c1bb-570d-4baf-a4f0-12eac51fe0c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:05.916142 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d2b8c1bb-570d-4baf-a4f0-12eac51fe0c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:05.916584 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d2b8c1bb-570d-4baf-a4f0-12eac51fe0c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:05.917332 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d2b8c1bb-570d-4baf-a4f0-12eac51fe0c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:05.917759 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d2b8c1bb-570d-4baf-a4f0-12eac51fe0c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:06.043696 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d2b8c1bb-570d-4baf-a4f0-12eac51fe0c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:06.052432 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d2b8c1bb-570d-4baf-a4f0-12eac51fe0c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:06.053945 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d2b8c1bb-570d-4baf-a4f0-12eac51fe0c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:06.055151 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d2b8c1bb-570d-4baf-a4f0-12eac51fe0c9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.149466 Jul 27 07:55:06.055713 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 362/705] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:55:05 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:55:06.370689 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-001018f1-cb64-40a2-a6e4-906a8a3ab50f req-53ee578e-0b5c-4183-a78e-235883495748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "880126db-79f5-4c11-a0b5-85a612a1662a", "name": "network-vif-plugged", "status": "completed", "tag": "4acbfc37-e1fc-4b8f-a717-ec89154e30e4"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:55:06.381816 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-001018f1-cb64-40a2-a6e4-906a8a3ab50f req-53ee578e-0b5c-4183-a78e-235883495748 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:06.382257 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-001018f1-cb64-40a2-a6e4-906a8a3ab50f req-53ee578e-0b5c-4183-a78e-235883495748 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:06.394626 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-001018f1-cb64-40a2-a6e4-906a8a3ab50f req-53ee578e-0b5c-4183-a78e-235883495748 service nova] Creating event network-vif-plugged:4acbfc37-e1fc-4b8f-a717-ec89154e30e4 for instance 880126db-79f5-4c11-a0b5-85a612a1662a on hv-cinder-82549 Jul 27 07:55:06.399644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-001018f1-cb64-40a2-a6e4-906a8a3ab50f req-53ee578e-0b5c-4183-a78e-235883495748 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032640 Jul 27 07:55:06.400422 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 344/706] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:55:06.501699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a8425305-1eee-4f35-abaa-6cd98258798d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:06.502236 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a8425305-1eee-4f35-abaa-6cd98258798d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:06.508994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a8425305-1eee-4f35-abaa-6cd98258798d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:06.509440 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a8425305-1eee-4f35-abaa-6cd98258798d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:06.510200 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a8425305-1eee-4f35-abaa-6cd98258798d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:06.510631 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a8425305-1eee-4f35-abaa-6cd98258798d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:06.558031 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9335ae4f-b45f-42b6-ae4b-2dca0410ac9c tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:06.558728 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-9335ae4f-b45f-42b6-ae4b-2dca0410ac9c tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:06.565020 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9335ae4f-b45f-42b6-ae4b-2dca0410ac9c tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:06.565472 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9335ae4f-b45f-42b6-ae4b-2dca0410ac9c tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:06.566252 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9335ae4f-b45f-42b6-ae4b-2dca0410ac9c tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:06.566687 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9335ae4f-b45f-42b6-ae4b-2dca0410ac9c tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:06.656095 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a8425305-1eee-4f35-abaa-6cd98258798d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:06.664588 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a8425305-1eee-4f35-abaa-6cd98258798d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1258 microversion: 2.1 time: 0.166713 Jul 27 07:55:06.665390 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 363/707] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:06 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:06.725328 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9335ae4f-b45f-42b6-ae4b-2dca0410ac9c tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:06.733707 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9335ae4f-b45f-42b6-ae4b-2dca0410ac9c tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1755 microversion: 2.1 time: 0.179840 Jul 27 07:55:06.734299 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 345/708] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:06 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:55:07.077851 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2f1e64dc-6fb3-4278-94ee-11678ed6bcd8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:07.078442 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2f1e64dc-6fb3-4278-94ee-11678ed6bcd8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:07.085120 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2f1e64dc-6fb3-4278-94ee-11678ed6bcd8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:07.085574 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2f1e64dc-6fb3-4278-94ee-11678ed6bcd8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:07.086353 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2f1e64dc-6fb3-4278-94ee-11678ed6bcd8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:07.086793 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2f1e64dc-6fb3-4278-94ee-11678ed6bcd8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:07.215904 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2f1e64dc-6fb3-4278-94ee-11678ed6bcd8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:07.225310 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2f1e64dc-6fb3-4278-94ee-11678ed6bcd8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:07.226833 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2f1e64dc-6fb3-4278-94ee-11678ed6bcd8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:07.228108 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2f1e64dc-6fb3-4278-94ee-11678ed6bcd8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.154258 Jul 27 07:55:07.228674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 364/709] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:55:07 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:55:07.686756 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-8a139f84-8c53-4fa7-90d4-48646b76eb2d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:07.687376 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-8a139f84-8c53-4fa7-90d4-48646b76eb2d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:07.694642 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8a139f84-8c53-4fa7-90d4-48646b76eb2d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:07.695135 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8a139f84-8c53-4fa7-90d4-48646b76eb2d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:07.695884 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8a139f84-8c53-4fa7-90d4-48646b76eb2d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:07.696310 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8a139f84-8c53-4fa7-90d4-48646b76eb2d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:07.756030 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7b1dd132-af0a-4c55-9e24-4cfe59b87a37 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:07.757007 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7b1dd132-af0a-4c55-9e24-4cfe59b87a37 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:07.763505 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7b1dd132-af0a-4c55-9e24-4cfe59b87a37 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:07.763962 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7b1dd132-af0a-4c55-9e24-4cfe59b87a37 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:07.764810 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7b1dd132-af0a-4c55-9e24-4cfe59b87a37 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:07.765251 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7b1dd132-af0a-4c55-9e24-4cfe59b87a37 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:07.871256 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8a139f84-8c53-4fa7-90d4-48646b76eb2d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:07.878855 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-8a139f84-8c53-4fa7-90d4-48646b76eb2d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1258 microversion: 2.1 time: 0.196209 Jul 27 07:55:07.879451 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 346/710] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:07 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1258 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:07.929094 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7b1dd132-af0a-4c55-9e24-4cfe59b87a37 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:07.937505 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7b1dd132-af0a-4c55-9e24-4cfe59b87a37 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1755 microversion: 2.1 time: 0.185964 Jul 27 07:55:07.938074 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 365/711] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:07 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:55:08.251067 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-08d365e4-b81e-4d20-b5c0-31ab42932981 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:08.251764 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-08d365e4-b81e-4d20-b5c0-31ab42932981 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:08.257898 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-08d365e4-b81e-4d20-b5c0-31ab42932981 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:08.258340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-08d365e4-b81e-4d20-b5c0-31ab42932981 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:08.259129 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-08d365e4-b81e-4d20-b5c0-31ab42932981 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:08.259559 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-08d365e4-b81e-4d20-b5c0-31ab42932981 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:08.389243 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-08d365e4-b81e-4d20-b5c0-31ab42932981 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:08.398403 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-08d365e4-b81e-4d20-b5c0-31ab42932981 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:08.400016 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-08d365e4-b81e-4d20-b5c0-31ab42932981 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:08.401231 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-08d365e4-b81e-4d20-b5c0-31ab42932981 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.154101 Jul 27 07:55:08.401797 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 347/712] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:55:08 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:55:08.903699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-de7b0bd0-b2ad-480d-9790-2f7f232a3e53 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:08.904358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-de7b0bd0-b2ad-480d-9790-2f7f232a3e53 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:08.911961 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de7b0bd0-b2ad-480d-9790-2f7f232a3e53 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:08.912525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de7b0bd0-b2ad-480d-9790-2f7f232a3e53 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:08.913329 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de7b0bd0-b2ad-480d-9790-2f7f232a3e53 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:08.913770 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de7b0bd0-b2ad-480d-9790-2f7f232a3e53 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:08.961012 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-8e93531d-74f4-4c9a-9ea3-5052b3fd235d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:08.961639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-8e93531d-74f4-4c9a-9ea3-5052b3fd235d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:08.968362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8e93531d-74f4-4c9a-9ea3-5052b3fd235d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:08.968810 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8e93531d-74f4-4c9a-9ea3-5052b3fd235d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:08.969582 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8e93531d-74f4-4c9a-9ea3-5052b3fd235d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:08.970020 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8e93531d-74f4-4c9a-9ea3-5052b3fd235d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:09.047264 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-de7b0bd0-b2ad-480d-9790-2f7f232a3e53 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:09.054749 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-de7b0bd0-b2ad-480d-9790-2f7f232a3e53 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1258 microversion: 2.1 time: 0.155112 Jul 27 07:55:09.055353 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 366/713] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:08 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:09.115692 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8e93531d-74f4-4c9a-9ea3-5052b3fd235d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:09.124264 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-8e93531d-74f4-4c9a-9ea3-5052b3fd235d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1755 microversion: 2.1 time: 0.168082 Jul 27 07:55:09.124836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 348/714] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:08 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:55:09.428676 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-83f116d7-e515-4061-840a-44ea603f1e23 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:09.428676 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-83f116d7-e515-4061-840a-44ea603f1e23 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:09.432709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-83f116d7-e515-4061-840a-44ea603f1e23 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:09.433169 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-83f116d7-e515-4061-840a-44ea603f1e23 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:09.433949 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-83f116d7-e515-4061-840a-44ea603f1e23 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:09.434535 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-83f116d7-e515-4061-840a-44ea603f1e23 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:09.563979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-83f116d7-e515-4061-840a-44ea603f1e23 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:09.572830 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-83f116d7-e515-4061-840a-44ea603f1e23 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:09.574535 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-83f116d7-e515-4061-840a-44ea603f1e23 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:09.575824 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-83f116d7-e515-4061-840a-44ea603f1e23 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.154656 Jul 27 07:55:09.576423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 367/715] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:55:09 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:55:10.075716 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-cf0eb4a4-f141-4b58-a5fd-eaec85ce0897 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:10.076335 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-cf0eb4a4-f141-4b58-a5fd-eaec85ce0897 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:10.083038 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cf0eb4a4-f141-4b58-a5fd-eaec85ce0897 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:10.083441 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cf0eb4a4-f141-4b58-a5fd-eaec85ce0897 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:10.084235 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cf0eb4a4-f141-4b58-a5fd-eaec85ce0897 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:10.084673 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cf0eb4a4-f141-4b58-a5fd-eaec85ce0897 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:10.145692 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5f265691-ec3a-4a25-a5d8-cd48c1404fd4 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:10.146392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5f265691-ec3a-4a25-a5d8-cd48c1404fd4 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:10.152873 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5f265691-ec3a-4a25-a5d8-cd48c1404fd4 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:10.153321 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5f265691-ec3a-4a25-a5d8-cd48c1404fd4 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:10.154103 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5f265691-ec3a-4a25-a5d8-cd48c1404fd4 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:10.154540 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5f265691-ec3a-4a25-a5d8-cd48c1404fd4 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:10.218126 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-cf0eb4a4-f141-4b58-a5fd-eaec85ce0897 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:10.226612 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-cf0eb4a4-f141-4b58-a5fd-eaec85ce0897 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1258 microversion: 2.1 time: 0.154673 Jul 27 07:55:10.227485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 349/716] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:10 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:10.310331 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5f265691-ec3a-4a25-a5d8-cd48c1404fd4 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:10.318300 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5f265691-ec3a-4a25-a5d8-cd48c1404fd4 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1758 microversion: 2.1 time: 0.176546 Jul 27 07:55:10.318870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 368/717] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:10 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:55:10.599833 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-35b1dc66-55a4-46d2-8906-7bc29c0d2e8f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:10.600453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-35b1dc66-55a4-46d2-8906-7bc29c0d2e8f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:10.606546 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-35b1dc66-55a4-46d2-8906-7bc29c0d2e8f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:10.607029 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-35b1dc66-55a4-46d2-8906-7bc29c0d2e8f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:10.607794 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-35b1dc66-55a4-46d2-8906-7bc29c0d2e8f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:10.608265 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-35b1dc66-55a4-46d2-8906-7bc29c0d2e8f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:10.759795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-35b1dc66-55a4-46d2-8906-7bc29c0d2e8f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:10.768253 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-35b1dc66-55a4-46d2-8906-7bc29c0d2e8f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:10.769760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-35b1dc66-55a4-46d2-8906-7bc29c0d2e8f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:10.771480 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-35b1dc66-55a4-46d2-8906-7bc29c0d2e8f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.176637 Jul 27 07:55:10.772041 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 350/718] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:55:10 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:55:11.248292 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-50d352c0-42f4-4342-8277-47a873b3237a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:11.248892 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-50d352c0-42f4-4342-8277-47a873b3237a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:11.267220 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-50d352c0-42f4-4342-8277-47a873b3237a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:11.267806 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-50d352c0-42f4-4342-8277-47a873b3237a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:11.268764 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-50d352c0-42f4-4342-8277-47a873b3237a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:11.269337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-50d352c0-42f4-4342-8277-47a873b3237a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:11.363452 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-631a22ef-ff81-4108-a5cc-23afd75ef729 req-760085e0-0467-4ece-b1da-1af94140a7bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0b0841-bd90-4361-9866-e51a7c5db994", "name": "network-vif-plugged", "status": "completed", "tag": "6eaca3f7-b87d-4766-ad60-73f678ccc493"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:55:11.377215 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-631a22ef-ff81-4108-a5cc-23afd75ef729 req-760085e0-0467-4ece-b1da-1af94140a7bb service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:11.377912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-631a22ef-ff81-4108-a5cc-23afd75ef729 req-760085e0-0467-4ece-b1da-1af94140a7bb service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:11.394207 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-631a22ef-ff81-4108-a5cc-23afd75ef729 req-760085e0-0467-4ece-b1da-1af94140a7bb service nova] Creating event network-vif-plugged:6eaca3f7-b87d-4766-ad60-73f678ccc493 for instance fb0b0841-bd90-4361-9866-e51a7c5db994 on hv-cinder-82549 Jul 27 07:55:11.400179 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-631a22ef-ff81-4108-a5cc-23afd75ef729 req-760085e0-0467-4ece-b1da-1af94140a7bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040165 Jul 27 07:55:11.401414 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 351/719] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:55:11.461961 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-50d352c0-42f4-4342-8277-47a873b3237a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:11.469636 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-50d352c0-42f4-4342-8277-47a873b3237a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1258 microversion: 2.1 time: 0.225599 Jul 27 07:55:11.470203 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 369/720] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:11 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1258 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:11.796085 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9c49c302-ebb2-4ebc-96da-42beda107e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:11.796705 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-9c49c302-ebb2-4ebc-96da-42beda107e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:11.803054 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9c49c302-ebb2-4ebc-96da-42beda107e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:11.803503 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9c49c302-ebb2-4ebc-96da-42beda107e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:11.804281 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9c49c302-ebb2-4ebc-96da-42beda107e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:11.804716 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9c49c302-ebb2-4ebc-96da-42beda107e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:11.945561 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9c49c302-ebb2-4ebc-96da-42beda107e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:11.954062 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9c49c302-ebb2-4ebc-96da-42beda107e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:11.955616 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9c49c302-ebb2-4ebc-96da-42beda107e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:11.956792 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9c49c302-ebb2-4ebc-96da-42beda107e9d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1810 microversion: 2.20 time: 0.166051 Jul 27 07:55:11.958726 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 352/721] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:55:11 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:55:12.490752 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f74b9696-b331-4373-b69e-1c070025900b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:12.491472 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f74b9696-b331-4373-b69e-1c070025900b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:12.498036 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f74b9696-b331-4373-b69e-1c070025900b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:12.498481 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f74b9696-b331-4373-b69e-1c070025900b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:12.499283 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f74b9696-b331-4373-b69e-1c070025900b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:12.499721 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f74b9696-b331-4373-b69e-1c070025900b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:12.636768 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f74b9696-b331-4373-b69e-1c070025900b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:12.644205 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f74b9696-b331-4373-b69e-1c070025900b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1258 microversion: 2.1 time: 0.157927 Jul 27 07:55:12.644778 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 370/722] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:12 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:12.981941 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a53a02c1-81ac-4584-8955-b716216c6276 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:12.982518 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a53a02c1-81ac-4584-8955-b716216c6276 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:12.989924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a53a02c1-81ac-4584-8955-b716216c6276 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:12.990367 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a53a02c1-81ac-4584-8955-b716216c6276 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:12.991170 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a53a02c1-81ac-4584-8955-b716216c6276 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:12.991603 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a53a02c1-81ac-4584-8955-b716216c6276 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:13.128682 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a53a02c1-81ac-4584-8955-b716216c6276 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:13.137740 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a53a02c1-81ac-4584-8955-b716216c6276 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:13.139299 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a53a02c1-81ac-4584-8955-b716216c6276 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:13.140464 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a53a02c1-81ac-4584-8955-b716216c6276 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1797 microversion: 2.20 time: 0.162612 Jul 27 07:55:13.141031 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 353/723] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:55:12 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1797 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:55:13.665722 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0face368-0587-4cb4-b6f9-863f95a69863 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:13.666363 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0face368-0587-4cb4-b6f9-863f95a69863 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:13.673130 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0face368-0587-4cb4-b6f9-863f95a69863 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:13.673577 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0face368-0587-4cb4-b6f9-863f95a69863 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:13.674344 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0face368-0587-4cb4-b6f9-863f95a69863 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:13.674784 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0face368-0587-4cb4-b6f9-863f95a69863 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:13.805860 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0face368-0587-4cb4-b6f9-863f95a69863 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:13.813811 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0face368-0587-4cb4-b6f9-863f95a69863 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1258 microversion: 2.1 time: 0.152605 Jul 27 07:55:13.814381 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 371/724] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:13 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:55:14.835218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2f2a6d2d-819a-4172-9953-d437a32fe200 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:14.835852 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2f2a6d2d-819a-4172-9953-d437a32fe200 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:14.842360 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2f2a6d2d-819a-4172-9953-d437a32fe200 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:14.842800 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2f2a6d2d-819a-4172-9953-d437a32fe200 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:14.843582 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2f2a6d2d-819a-4172-9953-d437a32fe200 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:14.844023 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2f2a6d2d-819a-4172-9953-d437a32fe200 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:14.973226 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2f2a6d2d-819a-4172-9953-d437a32fe200 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:14.981113 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2f2a6d2d-819a-4172-9953-d437a32fe200 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1258 microversion: 2.1 time: 0.150424 Jul 27 07:55:14.981669 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 354/725] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:14 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:15.851666 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9cf41060-9d52-4e61-a0e3-3fa1aa58593c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ea21f82-ce86-4800-8924-54d7fb5baedd"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:55:15.854096 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9cf41060-9d52-4e61-a0e3-3fa1aa58593c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:15.860173 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9cf41060-9d52-4e61-a0e3-3fa1aa58593c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:15.860617 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9cf41060-9d52-4e61-a0e3-3fa1aa58593c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:15.861378 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9cf41060-9d52-4e61-a0e3-3fa1aa58593c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:15.861810 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9cf41060-9d52-4e61-a0e3-3fa1aa58593c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:16.002293 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7958018a-a00e-4aad-8249-bd24f5442301 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:16.002964 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-7958018a-a00e-4aad-8249-bd24f5442301 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:16.010359 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7958018a-a00e-4aad-8249-bd24f5442301 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:16.010748 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7958018a-a00e-4aad-8249-bd24f5442301 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:16.011555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7958018a-a00e-4aad-8249-bd24f5442301 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:16.011988 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7958018a-a00e-4aad-8249-bd24f5442301 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:16.151098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7958018a-a00e-4aad-8249-bd24f5442301 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:16.155416 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9cf41060-9d52-4e61-a0e3-3fa1aa58593c tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "POST /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.408220 Jul 27 07:55:16.156139 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 372/726] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Jul 27 07:55:15 2022] POST /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:55:16.158683 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7958018a-a00e-4aad-8249-bd24f5442301 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1258 microversion: 2.1 time: 0.160295 Jul 27 07:55:16.159286 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 355/727] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:15 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:55:17.182295 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-87a00b2f-5d88-4d50-997e-3aa3f0650d75 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:17.183045 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-87a00b2f-5d88-4d50-997e-3aa3f0650d75 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:17.189445 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-87a00b2f-5d88-4d50-997e-3aa3f0650d75 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:17.189895 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-87a00b2f-5d88-4d50-997e-3aa3f0650d75 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:17.190662 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-87a00b2f-5d88-4d50-997e-3aa3f0650d75 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:17.191147 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-87a00b2f-5d88-4d50-997e-3aa3f0650d75 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:17.329159 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-87a00b2f-5d88-4d50-997e-3aa3f0650d75 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:17.333585 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:55:17.339263 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-87a00b2f-5d88-4d50-997e-3aa3f0650d75 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1258 microversion: 2.1 time: 0.162576 Jul 27 07:55:17.339918 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 373/728] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:17 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:18.361260 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c368504f-67cb-4bc5-86da-e8bb8571ade8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:18.362054 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c368504f-67cb-4bc5-86da-e8bb8571ade8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:18.369504 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c368504f-67cb-4bc5-86da-e8bb8571ade8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:18.369960 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c368504f-67cb-4bc5-86da-e8bb8571ade8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:18.370725 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c368504f-67cb-4bc5-86da-e8bb8571ade8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:18.371208 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c368504f-67cb-4bc5-86da-e8bb8571ade8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:18.375371 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=100 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:55:18.506867 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c368504f-67cb-4bc5-86da-e8bb8571ade8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:18.514710 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c368504f-67cb-4bc5-86da-e8bb8571ade8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1258 microversion: 2.1 time: 0.157279 Jul 27 07:55:18.515549 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 356/729] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:18 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:19.537876 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-cad5a895-d620-4da0-bf8e-f5d4529ec61e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:19.538497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-cad5a895-d620-4da0-bf8e-f5d4529ec61e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:19.546418 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cad5a895-d620-4da0-bf8e-f5d4529ec61e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:19.546869 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cad5a895-d620-4da0-bf8e-f5d4529ec61e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:19.547669 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cad5a895-d620-4da0-bf8e-f5d4529ec61e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:19.548111 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cad5a895-d620-4da0-bf8e-f5d4529ec61e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:19.682975 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-cad5a895-d620-4da0-bf8e-f5d4529ec61e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:19.690850 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-cad5a895-d620-4da0-bf8e-f5d4529ec61e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1441 microversion: 2.1 time: 0.157995 Jul 27 07:55:19.691445 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 374/730] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:19 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1441 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:19.711988 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-8c084ec5-b17f-41d7-bc75-e35b53152e3f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:19.712598 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-8c084ec5-b17f-41d7-bc75-e35b53152e3f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:19.719159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8c084ec5-b17f-41d7-bc75-e35b53152e3f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:19.719606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8c084ec5-b17f-41d7-bc75-e35b53152e3f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:19.720370 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8c084ec5-b17f-41d7-bc75-e35b53152e3f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:19.720799 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8c084ec5-b17f-41d7-bc75-e35b53152e3f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:19.856522 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8c084ec5-b17f-41d7-bc75-e35b53152e3f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:19.864070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-8c084ec5-b17f-41d7-bc75-e35b53152e3f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1441 microversion: 2.1 time: 0.155851 Jul 27 07:55:19.864635 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 357/731] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:19 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1441 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:21.827783 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-435d6455-c90c-4fc5-8982-391039a04fb2 req-dc2ef99d-0229-46df-9a00-ecc0d12f2ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0b0841-bd90-4361-9866-e51a7c5db994", "tag": "6eaca3f7-b87d-4766-ad60-73f678ccc493"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:55:21.838163 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-435d6455-c90c-4fc5-8982-391039a04fb2 req-dc2ef99d-0229-46df-9a00-ecc0d12f2ba8 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:21.838606 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-435d6455-c90c-4fc5-8982-391039a04fb2 req-dc2ef99d-0229-46df-9a00-ecc0d12f2ba8 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:21.850784 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-435d6455-c90c-4fc5-8982-391039a04fb2 req-dc2ef99d-0229-46df-9a00-ecc0d12f2ba8 service nova] Creating event network-changed:6eaca3f7-b87d-4766-ad60-73f678ccc493 for instance fb0b0841-bd90-4361-9866-e51a7c5db994 on hv-cinder-82549 Jul 27 07:55:21.855874 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-435d6455-c90c-4fc5-8982-391039a04fb2 req-dc2ef99d-0229-46df-9a00-ecc0d12f2ba8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086104 Jul 27 07:55:21.856475 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 375/732] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:55:24.750741 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ab1858e4-d06a-4cce-a180-0ac0e4ff3141 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:55:24.753055 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ab1858e4-d06a-4cce-a180-0ac0e4ff3141 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:24.759818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ab1858e4-d06a-4cce-a180-0ac0e4ff3141 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:24.760265 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ab1858e4-d06a-4cce-a180-0ac0e4ff3141 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:24.761071 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ab1858e4-d06a-4cce-a180-0ac0e4ff3141 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:24.761512 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ab1858e4-d06a-4cce-a180-0ac0e4ff3141 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:24.783599 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.objects.instance [None req-ab1858e4-d06a-4cce-a180-0ac0e4ff3141 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lazy-loading 'flavor' on Instance uuid a94a8a11-679a-4c4c-b46b-c4a323068eb7 {{(pid=117779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:55:24.907693 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ab1858e4-d06a-4cce-a180-0ac0e4ff3141 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "POST /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/action" status: 200 len: 32 microversion: 2.1 time: 0.160998 Jul 27 07:55:24.908344 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 358/733] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Jul 27 07:55:24 2022] POST /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 07:55:24.919625 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b95f4f17-7fd6-40b2-ab19-c6c99e8bd245 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:24.920328 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b95f4f17-7fd6-40b2-ab19-c6c99e8bd245 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:24.927376 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b95f4f17-7fd6-40b2-ab19-c6c99e8bd245 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:24.927838 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b95f4f17-7fd6-40b2-ab19-c6c99e8bd245 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:24.928651 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b95f4f17-7fd6-40b2-ab19-c6c99e8bd245 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:24.929109 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b95f4f17-7fd6-40b2-ab19-c6c99e8bd245 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:25.061420 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b95f4f17-7fd6-40b2-ab19-c6c99e8bd245 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:25.069482 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b95f4f17-7fd6-40b2-ab19-c6c99e8bd245 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1734 microversion: 2.1 time: 0.154715 Jul 27 07:55:25.070057 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 376/734] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:24 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:26.094469 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-5536d2f0-ed14-40ce-9419-9000ac725c9d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:26.095190 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-5536d2f0-ed14-40ce-9419-9000ac725c9d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:26.102865 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5536d2f0-ed14-40ce-9419-9000ac725c9d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:26.103336 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5536d2f0-ed14-40ce-9419-9000ac725c9d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:26.104107 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5536d2f0-ed14-40ce-9419-9000ac725c9d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:26.104530 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5536d2f0-ed14-40ce-9419-9000ac725c9d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:26.240245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-5536d2f0-ed14-40ce-9419-9000ac725c9d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:26.248322 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-5536d2f0-ed14-40ce-9419-9000ac725c9d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1734 microversion: 2.1 time: 0.161319 Jul 27 07:55:26.248928 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 359/735] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:26 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:27.271219 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-28cfee78-f4f0-4a6f-bc47-c52a60005d17 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:27.271830 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-28cfee78-f4f0-4a6f-bc47-c52a60005d17 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:27.278349 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-28cfee78-f4f0-4a6f-bc47-c52a60005d17 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:27.278803 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-28cfee78-f4f0-4a6f-bc47-c52a60005d17 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:27.279602 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-28cfee78-f4f0-4a6f-bc47-c52a60005d17 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:27.280040 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-28cfee78-f4f0-4a6f-bc47-c52a60005d17 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:27.413907 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-28cfee78-f4f0-4a6f-bc47-c52a60005d17 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:27.421892 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-28cfee78-f4f0-4a6f-bc47-c52a60005d17 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1734 microversion: 2.1 time: 0.155112 Jul 27 07:55:27.422466 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 377/736] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:27 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:28.444233 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-bf8ada49-2f2d-44bb-9d18-36afa7f90cbe tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:28.444950 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-bf8ada49-2f2d-44bb-9d18-36afa7f90cbe tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:28.447472 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=54 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:55:28.452914 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bf8ada49-2f2d-44bb-9d18-36afa7f90cbe tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:28.453399 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bf8ada49-2f2d-44bb-9d18-36afa7f90cbe tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:28.454170 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bf8ada49-2f2d-44bb-9d18-36afa7f90cbe tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:28.454654 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bf8ada49-2f2d-44bb-9d18-36afa7f90cbe tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:28.582793 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-bf8ada49-2f2d-44bb-9d18-36afa7f90cbe tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:28.590700 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-bf8ada49-2f2d-44bb-9d18-36afa7f90cbe tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1734 microversion: 2.1 time: 0.151075 Jul 27 07:55:28.591292 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 360/737] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:28 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:55:29.612271 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d157fa15-e003-41d7-b44d-e19637c174c5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:29.612900 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d157fa15-e003-41d7-b44d-e19637c174c5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:29.619667 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d157fa15-e003-41d7-b44d-e19637c174c5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:29.620121 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d157fa15-e003-41d7-b44d-e19637c174c5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:29.620891 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d157fa15-e003-41d7-b44d-e19637c174c5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:29.621336 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d157fa15-e003-41d7-b44d-e19637c174c5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:29.750463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d157fa15-e003-41d7-b44d-e19637c174c5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:29.760069 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d157fa15-e003-41d7-b44d-e19637c174c5 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1734 microversion: 2.1 time: 0.151708 Jul 27 07:55:29.760654 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 378/738] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:29 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:30.787671 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a8cc4c22-f579-44f1-9372-428e0983792f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:30.788216 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a8cc4c22-f579-44f1-9372-428e0983792f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:30.794797 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a8cc4c22-f579-44f1-9372-428e0983792f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:30.795274 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a8cc4c22-f579-44f1-9372-428e0983792f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:30.796041 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a8cc4c22-f579-44f1-9372-428e0983792f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:30.796471 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a8cc4c22-f579-44f1-9372-428e0983792f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:30.934405 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a8cc4c22-f579-44f1-9372-428e0983792f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:30.942335 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a8cc4c22-f579-44f1-9372-428e0983792f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1734 microversion: 2.1 time: 0.160492 Jul 27 07:55:30.942906 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 361/739] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:30 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:31.965386 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a44c6537-a78e-48ca-ade7-63b2247f8b05 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:31.966666 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a44c6537-a78e-48ca-ade7-63b2247f8b05 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:31.969585 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=48 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:55:31.976051 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a44c6537-a78e-48ca-ade7-63b2247f8b05 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:31.976521 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a44c6537-a78e-48ca-ade7-63b2247f8b05 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:31.977645 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a44c6537-a78e-48ca-ade7-63b2247f8b05 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:31.978091 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a44c6537-a78e-48ca-ade7-63b2247f8b05 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:32.108557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a44c6537-a78e-48ca-ade7-63b2247f8b05 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:32.117207 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a44c6537-a78e-48ca-ade7-63b2247f8b05 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1734 microversion: 2.1 time: 0.156451 Jul 27 07:55:32.117838 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 379/740] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:31 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:33.137635 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1a9cae16-c803-4cee-9433-f9fca7c9908d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:33.138240 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1a9cae16-c803-4cee-9433-f9fca7c9908d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:33.145550 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1a9cae16-c803-4cee-9433-f9fca7c9908d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:33.146097 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1a9cae16-c803-4cee-9433-f9fca7c9908d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:33.147460 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1a9cae16-c803-4cee-9433-f9fca7c9908d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:33.147899 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1a9cae16-c803-4cee-9433-f9fca7c9908d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:33.371049 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1a9cae16-c803-4cee-9433-f9fca7c9908d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:33.379557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1a9cae16-c803-4cee-9433-f9fca7c9908d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1734 microversion: 2.1 time: 0.245729 Jul 27 07:55:33.380353 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 362/741] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:33 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1734 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:34.402175 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3b79aa5b-6ac9-40bf-8fae-2b1d92ff8606 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:34.402736 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3b79aa5b-6ac9-40bf-8fae-2b1d92ff8606 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:34.409260 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b79aa5b-6ac9-40bf-8fae-2b1d92ff8606 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:34.409708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b79aa5b-6ac9-40bf-8fae-2b1d92ff8606 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:34.410476 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b79aa5b-6ac9-40bf-8fae-2b1d92ff8606 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:34.410936 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b79aa5b-6ac9-40bf-8fae-2b1d92ff8606 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:34.545106 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3b79aa5b-6ac9-40bf-8fae-2b1d92ff8606 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:34.553690 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3b79aa5b-6ac9-40bf-8fae-2b1d92ff8606 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1734 microversion: 2.1 time: 0.155435 Jul 27 07:55:34.554251 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 380/742] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:34 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:35.576877 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-63c40717-f4ec-42c4-941f-a4913627a6f1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:35.577491 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-63c40717-f4ec-42c4-941f-a4913627a6f1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:35.584775 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-63c40717-f4ec-42c4-941f-a4913627a6f1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:35.585264 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-63c40717-f4ec-42c4-941f-a4913627a6f1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:35.586026 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-63c40717-f4ec-42c4-941f-a4913627a6f1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:35.586467 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-63c40717-f4ec-42c4-941f-a4913627a6f1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:35.983508 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-63c40717-f4ec-42c4-941f-a4913627a6f1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:35.991349 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-63c40717-f4ec-42c4-941f-a4913627a6f1 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1734 microversion: 2.1 time: 0.419807 Jul 27 07:55:35.991916 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 363/743] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:35 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1734 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:37.013000 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-caf328f9-cade-4c8c-ab99-bf8650c47608 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:37.013616 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-caf328f9-cade-4c8c-ab99-bf8650c47608 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:37.020231 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-caf328f9-cade-4c8c-ab99-bf8650c47608 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:37.020689 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-caf328f9-cade-4c8c-ab99-bf8650c47608 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:37.021464 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-caf328f9-cade-4c8c-ab99-bf8650c47608 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:37.021908 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-caf328f9-cade-4c8c-ab99-bf8650c47608 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:37.157712 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-caf328f9-cade-4c8c-ab99-bf8650c47608 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:37.166420 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-caf328f9-cade-4c8c-ab99-bf8650c47608 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1734 microversion: 2.1 time: 0.157416 Jul 27 07:55:37.167008 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 381/744] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:37 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:38.191198 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-959c2739-f6d0-4a52-aaef-5e99cfb92690 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:38.191838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-959c2739-f6d0-4a52-aaef-5e99cfb92690 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:38.198508 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-959c2739-f6d0-4a52-aaef-5e99cfb92690 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:38.198984 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-959c2739-f6d0-4a52-aaef-5e99cfb92690 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:38.199740 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-959c2739-f6d0-4a52-aaef-5e99cfb92690 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:38.200173 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-959c2739-f6d0-4a52-aaef-5e99cfb92690 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:38.327860 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-959c2739-f6d0-4a52-aaef-5e99cfb92690 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:38.335919 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-959c2739-f6d0-4a52-aaef-5e99cfb92690 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1734 microversion: 2.1 time: 0.151598 Jul 27 07:55:38.336481 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 364/745] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:38 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:39.357151 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-76a2a970-e76e-422a-bab6-6e17ca9180e2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:39.357744 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-76a2a970-e76e-422a-bab6-6e17ca9180e2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:39.364246 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-76a2a970-e76e-422a-bab6-6e17ca9180e2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:39.364691 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-76a2a970-e76e-422a-bab6-6e17ca9180e2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:39.365486 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-76a2a970-e76e-422a-bab6-6e17ca9180e2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:39.365924 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-76a2a970-e76e-422a-bab6-6e17ca9180e2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:39.504202 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-76a2a970-e76e-422a-bab6-6e17ca9180e2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:39.512648 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-76a2a970-e76e-422a-bab6-6e17ca9180e2 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1734 microversion: 2.1 time: 0.159342 Jul 27 07:55:39.513207 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 382/746] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:39 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:40.533665 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-4ce537e5-4df3-4278-a4cc-8ebb73717b0f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:40.534272 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-4ce537e5-4df3-4278-a4cc-8ebb73717b0f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:40.540876 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4ce537e5-4df3-4278-a4cc-8ebb73717b0f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:40.541318 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4ce537e5-4df3-4278-a4cc-8ebb73717b0f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:40.542080 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4ce537e5-4df3-4278-a4cc-8ebb73717b0f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:40.542511 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4ce537e5-4df3-4278-a4cc-8ebb73717b0f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:40.673370 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-4ce537e5-4df3-4278-a4cc-8ebb73717b0f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:40.681362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-4ce537e5-4df3-4278-a4cc-8ebb73717b0f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1734 microversion: 2.1 time: 0.151513 Jul 27 07:55:40.681862 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 365/747] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:40 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:41.702106 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-97707e9d-1092-4278-a3d7-5af352153265 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:41.702800 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-97707e9d-1092-4278-a3d7-5af352153265 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:41.710057 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-97707e9d-1092-4278-a3d7-5af352153265 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:41.710522 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-97707e9d-1092-4278-a3d7-5af352153265 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:41.711317 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-97707e9d-1092-4278-a3d7-5af352153265 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:41.711775 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-97707e9d-1092-4278-a3d7-5af352153265 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:41.843348 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-97707e9d-1092-4278-a3d7-5af352153265 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:41.851630 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-97707e9d-1092-4278-a3d7-5af352153265 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1734 microversion: 2.1 time: 0.153652 Jul 27 07:55:41.852251 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 383/748] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:41 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:42.872753 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-23c4668f-711b-40ee-92be-01d64d5d1699 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:42.873359 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-23c4668f-711b-40ee-92be-01d64d5d1699 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:42.880059 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-23c4668f-711b-40ee-92be-01d64d5d1699 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:42.880507 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-23c4668f-711b-40ee-92be-01d64d5d1699 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:42.881329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-23c4668f-711b-40ee-92be-01d64d5d1699 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:42.881764 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-23c4668f-711b-40ee-92be-01d64d5d1699 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:43.009345 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-23c4668f-711b-40ee-92be-01d64d5d1699 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:43.017248 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-23c4668f-711b-40ee-92be-01d64d5d1699 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1734 microversion: 2.1 time: 0.148399 Jul 27 07:55:43.017807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 366/749] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:42 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:44.038768 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c10b4039-6a75-4380-aeed-0a99f55c487f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:44.039415 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c10b4039-6a75-4380-aeed-0a99f55c487f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:44.046117 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c10b4039-6a75-4380-aeed-0a99f55c487f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:44.046567 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c10b4039-6a75-4380-aeed-0a99f55c487f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:44.047369 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c10b4039-6a75-4380-aeed-0a99f55c487f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:44.047808 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c10b4039-6a75-4380-aeed-0a99f55c487f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:44.176704 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c10b4039-6a75-4380-aeed-0a99f55c487f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:44.184714 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c10b4039-6a75-4380-aeed-0a99f55c487f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1734 microversion: 2.1 time: 0.150364 Jul 27 07:55:44.185285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 384/750] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:44 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:45.207108 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7f0a50b5-a5b1-405e-b795-42c012920b63 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:45.207722 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-7f0a50b5-a5b1-405e-b795-42c012920b63 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:45.213827 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7f0a50b5-a5b1-405e-b795-42c012920b63 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:45.214281 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7f0a50b5-a5b1-405e-b795-42c012920b63 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:45.215081 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7f0a50b5-a5b1-405e-b795-42c012920b63 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:45.215528 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7f0a50b5-a5b1-405e-b795-42c012920b63 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:45.345374 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7f0a50b5-a5b1-405e-b795-42c012920b63 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:45.353483 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7f0a50b5-a5b1-405e-b795-42c012920b63 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1734 microversion: 2.1 time: 0.150516 Jul 27 07:55:45.354051 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 367/751] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:45 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:46.374943 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-011073c2-45e2-4e5b-b80a-759773756e03 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:46.375545 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-011073c2-45e2-4e5b-b80a-759773756e03 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:46.382056 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-011073c2-45e2-4e5b-b80a-759773756e03 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:46.382512 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-011073c2-45e2-4e5b-b80a-759773756e03 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:46.383323 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-011073c2-45e2-4e5b-b80a-759773756e03 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:46.383763 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-011073c2-45e2-4e5b-b80a-759773756e03 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:46.518376 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-011073c2-45e2-4e5b-b80a-759773756e03 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:46.526963 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-011073c2-45e2-4e5b-b80a-759773756e03 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1714 microversion: 2.1 time: 0.155870 Jul 27 07:55:46.527536 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 385/752] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:46 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:46.587132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-60c05e5e-6183-49a5-8a85-dff6016c6097 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:46.587678 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-60c05e5e-6183-49a5-8a85-dff6016c6097 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:46.594177 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-60c05e5e-6183-49a5-8a85-dff6016c6097 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:46.594620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-60c05e5e-6183-49a5-8a85-dff6016c6097 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:46.595398 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-60c05e5e-6183-49a5-8a85-dff6016c6097 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:46.595831 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-60c05e5e-6183-49a5-8a85-dff6016c6097 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:46.717188 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-60c05e5e-6183-49a5-8a85-dff6016c6097 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] HTTP exception thrown: Cannot 'detach_volume' instance a94a8a11-679a-4c4c-b46b-c4a323068eb7 while it is in vm_state rescued Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-60c05e5e-6183-49a5-8a85-dff6016c6097 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Request method failure captured: Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: DELETE /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/os-volume_attachments/8ea21f82-ce86-4800-8924-54d7fb5baedd HTTP/1.1 Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O4UORz8wXhJ1kpiVNKXyE9VfzhMjRPMohCBHR61uSEgltK23AovTklhZktQwS1YkSIKv0p3xV2eZ4RBk4xLQVS9IMyH6g9DNMRWw9sV4BpxkaTRoJnwP5qMK153QRb-rvTyPfZE1GV6jzU-bzssuyWDHqvLNYZVXDmSYB5S7JuTYMo Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: c8e43fa41dc8445abed15accf9163b32 Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2087922844 Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 07:55:46.718785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 07:55:46.720379 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:55:46.720379 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2087922844 Jul 27 07:55:46.720379 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: c8e43fa41dc8445abed15accf9163b32 Jul 27 07:55:46.720379 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2087922844 Jul 27 07:55:46.720379 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-ServerRescueNegativeTestJSON-2087922844-project Jul 27 07:55:46.720379 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 07:55:46.720379 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 07:55:46.720379 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: cb1cee30bc59446d882880d978b78bc2 Jul 27 07:55:46.720379 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2087922844-project Jul 27 07:55:46.720379 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 07:55:46.720379 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Cannot 'detach_volume' instance a94a8a11-679a-4c4c-b46b-c4a323068eb7 while it is in vm_state rescued Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'server_id': 'a94a8a11-679a-4c4c-b46b-c4a323068eb7', 'id': '8ea21f82-ce86-4800-8924-54d7fb5baedd'} Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a94a8a11-679a-4c4c-b46b-c4a323068eb7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:55:46.721159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:55:46.722433 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 27 07:55:46.722433 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 27 07:55:46.722433 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 27 07:55:46.722433 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 27 07:55:46.722433 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a94a8a11-679a-4c4c-b46b-c4a323068eb7 while it is in vm_state rescued Jul 27 07:55:46.722433 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:55:46.722433 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:55:46.722433 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:55:46.722433 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:55:46.722433 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:55:46.722433 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:55:46.722433 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:55:46.722433 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:55:46.722433 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a94a8a11-679a-4c4c-b46b-c4a323068eb7 while it is in vm_state rescued Jul 27 07:55:46.722433 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:55:46.722433 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-60c05e5e-6183-49a5-8a85-dff6016c6097 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Returning 409 to user: Cannot 'detach_volume' instance a94a8a11-679a-4c4c-b46b-c4a323068eb7 while it is in vm_state rescued {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:55:46.724261 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-60c05e5e-6183-49a5-8a85-dff6016c6097 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/os-volume_attachments/8ea21f82-ce86-4800-8924-54d7fb5baedd" status: 409 len: 152 microversion: 2.1 time: 0.137120 Jul 27 07:55:46.724261 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 368/753] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Jul 27 07:55:46 2022] DELETE /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/os-volume_attachments/8ea21f82-ce86-4800-8924-54d7fb5baedd => generated 152 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 27 07:55:46.729846 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4905f823-1a34-4f10-9cc6-b4c14b1198b9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:55:46.730382 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4905f823-1a34-4f10-9cc6-b4c14b1198b9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:46.736360 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4905f823-1a34-4f10-9cc6-b4c14b1198b9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:46.736809 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4905f823-1a34-4f10-9cc6-b4c14b1198b9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:46.737568 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4905f823-1a34-4f10-9cc6-b4c14b1198b9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:46.738001 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4905f823-1a34-4f10-9cc6-b4c14b1198b9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:46.805398 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4905f823-1a34-4f10-9cc6-b4c14b1198b9 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "POST /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/action" status: 202 len: 0 microversion: 2.1 time: 0.079051 Jul 27 07:55:46.806192 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 386/754] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Jul 27 07:55:46 2022] POST /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 07:55:46.814284 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-45b943ff-9fd2-4412-8c97-772dcc149b4b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:46.814907 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-45b943ff-9fd2-4412-8c97-772dcc149b4b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:46.825006 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-45b943ff-9fd2-4412-8c97-772dcc149b4b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:46.825457 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-45b943ff-9fd2-4412-8c97-772dcc149b4b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:46.826268 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-45b943ff-9fd2-4412-8c97-772dcc149b4b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:46.826704 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-45b943ff-9fd2-4412-8c97-772dcc149b4b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:47.042698 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-45b943ff-9fd2-4412-8c97-772dcc149b4b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:47.050787 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-45b943ff-9fd2-4412-8c97-772dcc149b4b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1722 microversion: 2.1 time: 0.240294 Jul 27 07:55:47.051381 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 369/755] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:46 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:48.073595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-46242c9b-a4fd-4db8-9098-3040c1ed39e8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:48.074286 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-46242c9b-a4fd-4db8-9098-3040c1ed39e8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:48.081193 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-46242c9b-a4fd-4db8-9098-3040c1ed39e8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:48.081642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-46242c9b-a4fd-4db8-9098-3040c1ed39e8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:48.082408 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-46242c9b-a4fd-4db8-9098-3040c1ed39e8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:48.082843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-46242c9b-a4fd-4db8-9098-3040c1ed39e8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:48.214914 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-46242c9b-a4fd-4db8-9098-3040c1ed39e8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:48.223059 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-46242c9b-a4fd-4db8-9098-3040c1ed39e8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1722 microversion: 2.1 time: 0.153402 Jul 27 07:55:48.223618 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 387/756] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:48 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:49.244651 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1de169dd-c3d6-42c1-b8c2-c6036ebec91a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:49.245327 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1de169dd-c3d6-42c1-b8c2-c6036ebec91a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:49.251864 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1de169dd-c3d6-42c1-b8c2-c6036ebec91a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:49.252312 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1de169dd-c3d6-42c1-b8c2-c6036ebec91a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:49.253069 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1de169dd-c3d6-42c1-b8c2-c6036ebec91a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:49.253505 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1de169dd-c3d6-42c1-b8c2-c6036ebec91a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:49.256802 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:55:49.384648 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1de169dd-c3d6-42c1-b8c2-c6036ebec91a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:49.392575 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1de169dd-c3d6-42c1-b8c2-c6036ebec91a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1722 microversion: 2.1 time: 0.151781 Jul 27 07:55:49.393138 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 370/757] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:49 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:50.413631 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2633011e-a86b-49e0-80ec-0af7bb6fc71d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:50.414317 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2633011e-a86b-49e0-80ec-0af7bb6fc71d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:50.420810 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2633011e-a86b-49e0-80ec-0af7bb6fc71d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:50.421257 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2633011e-a86b-49e0-80ec-0af7bb6fc71d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:50.422142 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2633011e-a86b-49e0-80ec-0af7bb6fc71d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:50.422579 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2633011e-a86b-49e0-80ec-0af7bb6fc71d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:50.425419 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:55:50.708513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2633011e-a86b-49e0-80ec-0af7bb6fc71d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:50.716906 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2633011e-a86b-49e0-80ec-0af7bb6fc71d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1722 microversion: 2.1 time: 0.307187 Jul 27 07:55:50.717460 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 388/758] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:50 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:51.739157 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-cdf16d11-960a-43a1-869d-61a42d20d2a6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:51.739721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-cdf16d11-960a-43a1-869d-61a42d20d2a6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:51.746469 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cdf16d11-960a-43a1-869d-61a42d20d2a6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:51.746962 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cdf16d11-960a-43a1-869d-61a42d20d2a6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:51.747806 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cdf16d11-960a-43a1-869d-61a42d20d2a6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:51.748302 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cdf16d11-960a-43a1-869d-61a42d20d2a6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:51.892524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-cdf16d11-960a-43a1-869d-61a42d20d2a6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:51.901153 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-cdf16d11-960a-43a1-869d-61a42d20d2a6 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1728 microversion: 2.1 time: 0.165980 Jul 27 07:55:51.901716 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 371/759] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:51 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:51.921417 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c16b55ce-f57c-4025-8f37-3ee767ed9d6d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:51.921966 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c16b55ce-f57c-4025-8f37-3ee767ed9d6d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:51.928753 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c16b55ce-f57c-4025-8f37-3ee767ed9d6d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:51.929210 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c16b55ce-f57c-4025-8f37-3ee767ed9d6d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:51.929992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c16b55ce-f57c-4025-8f37-3ee767ed9d6d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:51.930433 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c16b55ce-f57c-4025-8f37-3ee767ed9d6d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:52.008566 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c16b55ce-f57c-4025-8f37-3ee767ed9d6d tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090947 Jul 27 07:55:52.009145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 389/760] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Jul 27 07:55:51 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:55:52.879483 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-ba559da7-d57d-4bfd-96ee-f41a080d4a99 req-5646eb1a-f415-4f26-b4b2-ed4df4959b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a94a8a11-679a-4c4c-b46b-c4a323068eb7", "tag": "42c28b8b-6ebb-416e-b231-309016bdd31f"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:55:52.891456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-ba559da7-d57d-4bfd-96ee-f41a080d4a99 req-5646eb1a-f415-4f26-b4b2-ed4df4959b8a service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:52.892011 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-ba559da7-d57d-4bfd-96ee-f41a080d4a99 req-5646eb1a-f415-4f26-b4b2-ed4df4959b8a service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:52.907885 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-ba559da7-d57d-4bfd-96ee-f41a080d4a99 req-5646eb1a-f415-4f26-b4b2-ed4df4959b8a service nova] Creating event network-changed:42c28b8b-6ebb-416e-b231-309016bdd31f for instance a94a8a11-679a-4c4c-b46b-c4a323068eb7 on hv-cinder-82549 Jul 27 07:55:52.913092 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-ba559da7-d57d-4bfd-96ee-f41a080d4a99 req-5646eb1a-f415-4f26-b4b2-ed4df4959b8a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037825 Jul 27 07:55:52.913844 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 372/761] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:55:53.490938 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-95528477-c157-4042-ab52-46c0ee555cd4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:53.491490 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-95528477-c157-4042-ab52-46c0ee555cd4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:53.498944 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-95528477-c157-4042-ab52-46c0ee555cd4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:53.499465 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-95528477-c157-4042-ab52-46c0ee555cd4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:53.500252 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-95528477-c157-4042-ab52-46c0ee555cd4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:53.500775 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-95528477-c157-4042-ab52-46c0ee555cd4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:53.628314 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-95528477-c157-4042-ab52-46c0ee555cd4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lazy-loading 'services' on Instance uuid 480abe1b-7355-48b3-928a-4b32cc678979 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:55:53.747464 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-95528477-c157-4042-ab52-46c0ee555cd4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "DELETE /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979/os-volume_attachments/be45c7b0-304f-4fbb-a54b-cc9cadef822c" status: 202 len: 0 microversion: 2.1 time: 0.382349 Jul 27 07:55:53.748054 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 390/762] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Jul 27 07:55:53 2022] DELETE /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979/os-volume_attachments/be45c7b0-304f-4fbb-a54b-cc9cadef822c => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 07:55:54.929453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-1f436599-f46e-4b94-9382-98257c277bc3 req-6b9d613c-a9e1-4ca0-9857-38a50d0965a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a94a8a11-679a-4c4c-b46b-c4a323068eb7", "tag": "42c28b8b-6ebb-416e-b231-309016bdd31f"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:55:54.939912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-1f436599-f46e-4b94-9382-98257c277bc3 req-6b9d613c-a9e1-4ca0-9857-38a50d0965a0 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:54.940350 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-1f436599-f46e-4b94-9382-98257c277bc3 req-6b9d613c-a9e1-4ca0-9857-38a50d0965a0 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:54.951682 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-1f436599-f46e-4b94-9382-98257c277bc3 req-6b9d613c-a9e1-4ca0-9857-38a50d0965a0 service nova] Creating event network-changed:42c28b8b-6ebb-416e-b231-309016bdd31f for instance a94a8a11-679a-4c4c-b46b-c4a323068eb7 on hv-cinder-82549 Jul 27 07:55:54.957088 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-1f436599-f46e-4b94-9382-98257c277bc3 req-6b9d613c-a9e1-4ca0-9857-38a50d0965a0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031959 Jul 27 07:55:54.957868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 373/763] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:55:55.627527 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4767204a-66e5-42b6-89eb-81191f0d02a9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:55.628112 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4767204a-66e5-42b6-89eb-81191f0d02a9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:55.634971 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4767204a-66e5-42b6-89eb-81191f0d02a9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:55.635355 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4767204a-66e5-42b6-89eb-81191f0d02a9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:55.636122 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4767204a-66e5-42b6-89eb-81191f0d02a9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:55.636556 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4767204a-66e5-42b6-89eb-81191f0d02a9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:55.660057 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4767204a-66e5-42b6-89eb-81191f0d02a9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28/ips" status: 200 len: 151 microversion: 2.1 time: 0.136477 Jul 27 07:55:55.660611 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 391/764] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Jul 27 07:55:55 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28/ips => generated 151 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:55:55.673917 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-6262ef9b-0df5-4f4d-8f9a-9675b41de40b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b23a632d-7382-4c14-ab62-17c1ea042e0e"}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:55:55.676258 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-6262ef9b-0df5-4f4d-8f9a-9675b41de40b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:55.682340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6262ef9b-0df5-4f4d-8f9a-9675b41de40b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:55.682778 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6262ef9b-0df5-4f4d-8f9a-9675b41de40b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:55.683558 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6262ef9b-0df5-4f4d-8f9a-9675b41de40b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:55.683985 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6262ef9b-0df5-4f4d-8f9a-9675b41de40b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:55.762827 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-6262ef9b-0df5-4f4d-8f9a-9675b41de40b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] HTTP exception thrown: Invalid volume: volume b23a632d-7382-4c14-ab62-17c1ea042e0e is already attached to instances: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-6262ef9b-0df5-4f4d-8f9a-9675b41de40b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Request method failure captured: Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: POST /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28/os-volume_attachments HTTP/1.1 Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 74 Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O4dQ6_Byd_TD8xXq_XrmoAr0FnlxsHKbwgQB4VAdIj5jmoqqdcTwHdIHCz-P_Xc5D3ADlxoxXrDt03El4_T3pb-Ot48U5BPQM4YOeGwU-aBen5Ed5125zCHbhJWC6gPVYWV7POipX99mXjlK6dYXCdPUlOB_d-CTA6UDGcIc4XpxPg Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 07:55:55.764604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 07:55:55.766183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:55:55.766183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 07:55:55.766183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 07:55:55.766183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 07:55:55.766183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 07:55:55.766183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 07:55:55.766183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 07:55:55.766183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: df8fb928aa42413b9d03e83f46dd48bc Jul 27 07:55:55.766183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 07:55:55.766183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Jul 27 07:55:55.766183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {"volumeAttachment": {"volumeId": "b23a632d-7382-4c14-ab62-17c1ea042e0e"}} Jul 27 07:55:55.766183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 07:55:55.767182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Invalid volume: volume b23a632d-7382-4c14-ab62-17c1ea042e0e is already attached to instances: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 Jul 27 07:55:55.767182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'server_id': 'a40e1f19-e3f4-4bc2-96d5-711703b48a28', 'body': {'volumeAttachment': {'volumeId': 'b23a632d-7382-4c14-ab62-17c1ea042e0e'}}} Jul 27 07:55:55.767182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:55:55.767182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:55:55.767182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 07:55:55.767182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 07:55:55.767182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 27 07:55:55.767182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 07:55:55.767182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 27 07:55:55.767182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 07:55:55.767182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 27 07:55:55.767182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 27 07:55:55.767182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 27 07:55:55.767182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 27 07:55:55.767182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b23a632d-7382-4c14-ab62-17c1ea042e0e is already attached to instances: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 Jul 27 07:55:55.767182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:55:55.767182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:55:55.767182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:55:55.767182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b23a632d-7382-4c14-ab62-17c1ea042e0e is already attached to instances: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:55:55.768473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:55:55.769738 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:55:55.769738 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:55:55.769738 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:55:55.769738 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b23a632d-7382-4c14-ab62-17c1ea042e0e is already attached to instances: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 Jul 27 07:55:55.769738 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:55:55.769738 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-6262ef9b-0df5-4f4d-8f9a-9675b41de40b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Returning 400 to user: Invalid volume: volume b23a632d-7382-4c14-ab62-17c1ea042e0e is already attached to instances: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:55:55.769738 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-6262ef9b-0df5-4f4d-8f9a-9675b41de40b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "POST /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096555 Jul 27 07:55:55.769738 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 374/765] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Jul 27 07:55:55 2022] POST /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 07:55:55.775938 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-31f2bafb-aaf5-4235-ba7b-f72289905eb9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:55.776433 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-31f2bafb-aaf5-4235-ba7b-f72289905eb9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:55.782392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-31f2bafb-aaf5-4235-ba7b-f72289905eb9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:55.782835 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-31f2bafb-aaf5-4235-ba7b-f72289905eb9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:55.783634 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-31f2bafb-aaf5-4235-ba7b-f72289905eb9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:55.784062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-31f2bafb-aaf5-4235-ba7b-f72289905eb9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:55.808176 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-31f2bafb-aaf5-4235-ba7b-f72289905eb9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 07:55:55.887894 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-31f2bafb-aaf5-4235-ba7b-f72289905eb9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 204 len: 0 microversion: 2.1 time: 0.115250 Jul 27 07:55:55.888933 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 392/766] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 07:55:55 2022] DELETE /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 07:55:55.898644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f2c91ac2-a494-41fb-a905-c8e757786276 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:55.899747 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f2c91ac2-a494-41fb-a905-c8e757786276 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:55.907166 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f2c91ac2-a494-41fb-a905-c8e757786276 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:55.907620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f2c91ac2-a494-41fb-a905-c8e757786276 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:55.908404 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f2c91ac2-a494-41fb-a905-c8e757786276 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:55.908852 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f2c91ac2-a494-41fb-a905-c8e757786276 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:55.938803 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-56e8ee4e-7afa-41da-bfa2-d4959bec214f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:55:55.945537 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-56e8ee4e-7afa-41da-bfa2-d4959bec214f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:55.946066 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-56e8ee4e-7afa-41da-bfa2-d4959bec214f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:55.968344 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-56e8ee4e-7afa-41da-bfa2-d4959bec214f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Going to try to stop instance {{(pid=117780) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 27 07:55:56.011584 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-56e8ee4e-7afa-41da-bfa2-d4959bec214f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "POST /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979/action" status: 202 len: 0 microversion: 2.1 time: 0.076929 Jul 27 07:55:56.012413 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 393/767] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Jul 27 07:55:55 2022] POST /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 07:55:56.020610 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7ac63fa5-a2f9-418f-aa5b-86a642c15eb4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:56.021345 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7ac63fa5-a2f9-418f-aa5b-86a642c15eb4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:56.027518 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7ac63fa5-a2f9-418f-aa5b-86a642c15eb4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:56.027967 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7ac63fa5-a2f9-418f-aa5b-86a642c15eb4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:56.028736 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7ac63fa5-a2f9-418f-aa5b-86a642c15eb4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:56.029173 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7ac63fa5-a2f9-418f-aa5b-86a642c15eb4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:56.044696 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f2c91ac2-a494-41fb-a905-c8e757786276 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:56.052148 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f2c91ac2-a494-41fb-a905-c8e757786276 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 200 len: 1682 microversion: 2.1 time: 0.158992 Jul 27 07:55:56.053213 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 375/768] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:55 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:56.158447 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7ac63fa5-a2f9-418f-aa5b-86a642c15eb4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:56.166529 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7ac63fa5-a2f9-418f-aa5b-86a642c15eb4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1677 microversion: 2.1 time: 0.150017 Jul 27 07:55:56.167152 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 394/769] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:56 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:55:57.074853 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1ded472d-26a7-43aa-a32c-482cad50e327 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:57.075468 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1ded472d-26a7-43aa-a32c-482cad50e327 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:57.081967 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1ded472d-26a7-43aa-a32c-482cad50e327 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:57.082412 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1ded472d-26a7-43aa-a32c-482cad50e327 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:57.083192 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1ded472d-26a7-43aa-a32c-482cad50e327 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:57.084249 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1ded472d-26a7-43aa-a32c-482cad50e327 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:57.187134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5161b463-d269-4be0-b81e-361478691c09 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:57.187744 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5161b463-d269-4be0-b81e-361478691c09 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:57.195691 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5161b463-d269-4be0-b81e-361478691c09 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:57.196133 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5161b463-d269-4be0-b81e-361478691c09 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:57.196903 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5161b463-d269-4be0-b81e-361478691c09 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:57.197466 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5161b463-d269-4be0-b81e-361478691c09 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:57.223053 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1ded472d-26a7-43aa-a32c-482cad50e327 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:57.232710 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1ded472d-26a7-43aa-a32c-482cad50e327 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 200 len: 1682 microversion: 2.1 time: 0.161607 Jul 27 07:55:57.233483 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 376/770] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:57 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:57.342772 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5161b463-d269-4be0-b81e-361478691c09 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:57.350647 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5161b463-d269-4be0-b81e-361478691c09 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1677 microversion: 2.1 time: 0.167340 Jul 27 07:55:57.351256 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 395/771] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:57 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:55:58.253985 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c2ce397a-28d9-4387-8c3b-45c1048d3b13 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:58.254580 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c2ce397a-28d9-4387-8c3b-45c1048d3b13 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:58.261780 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c2ce397a-28d9-4387-8c3b-45c1048d3b13 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:58.262234 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c2ce397a-28d9-4387-8c3b-45c1048d3b13 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:58.263112 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c2ce397a-28d9-4387-8c3b-45c1048d3b13 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:58.263552 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c2ce397a-28d9-4387-8c3b-45c1048d3b13 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:58.372184 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-93bb7cbe-b239-48c1-be90-cc3a02682ca9 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:58.372769 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-93bb7cbe-b239-48c1-be90-cc3a02682ca9 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:58.378857 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-93bb7cbe-b239-48c1-be90-cc3a02682ca9 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:58.379341 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-93bb7cbe-b239-48c1-be90-cc3a02682ca9 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:58.380118 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-93bb7cbe-b239-48c1-be90-cc3a02682ca9 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:58.381170 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-93bb7cbe-b239-48c1-be90-cc3a02682ca9 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:58.514153 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-93bb7cbe-b239-48c1-be90-cc3a02682ca9 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:58.521865 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-93bb7cbe-b239-48c1-be90-cc3a02682ca9 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1677 microversion: 2.1 time: 0.153816 Jul 27 07:55:58.522429 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 396/772] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:58 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:55:58.537839 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c2ce397a-28d9-4387-8c3b-45c1048d3b13 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:58.545594 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c2ce397a-28d9-4387-8c3b-45c1048d3b13 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 200 len: 1682 microversion: 2.1 time: 0.295449 Jul 27 07:55:58.546162 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 377/773] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:58 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 1682 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:59.069834 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-70530c80-f3f6-4e04-8603-6ea56d2b3301 req-be7acd08-5505-4688-8653-76ff6d321bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40e1f19-e3f4-4bc2-96d5-711703b48a28", "name": "network-vif-deleted", "tag": "2179df90-07c1-42e0-9748-4b2d651be4ca"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:55:59.080641 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-70530c80-f3f6-4e04-8603-6ea56d2b3301 req-be7acd08-5505-4688-8653-76ff6d321bb6 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:59.081068 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-70530c80-f3f6-4e04-8603-6ea56d2b3301 req-be7acd08-5505-4688-8653-76ff6d321bb6 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:59.093786 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-70530c80-f3f6-4e04-8603-6ea56d2b3301 req-be7acd08-5505-4688-8653-76ff6d321bb6 service nova] Creating event network-vif-deleted:2179df90-07c1-42e0-9748-4b2d651be4ca for instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 on hv-cinder-82549 Jul 27 07:55:59.099565 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-70530c80-f3f6-4e04-8603-6ea56d2b3301 req-be7acd08-5505-4688-8653-76ff6d321bb6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093657 Jul 27 07:55:59.103572 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 397/774] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:55:59.546847 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-81fdfe86-8c57-4a97-bdff-7cd10b53a10c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:59.548184 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-81fdfe86-8c57-4a97-bdff-7cd10b53a10c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:59.556225 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=36 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:55:59.558764 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-81fdfe86-8c57-4a97-bdff-7cd10b53a10c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:59.562302 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-81fdfe86-8c57-4a97-bdff-7cd10b53a10c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:59.563919 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-81fdfe86-8c57-4a97-bdff-7cd10b53a10c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:59.564532 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-81fdfe86-8c57-4a97-bdff-7cd10b53a10c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:59.569134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-977f0e8d-43f8-450d-8cc8-4c5ca96c90e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:55:59.571666 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-977f0e8d-43f8-450d-8cc8-4c5ca96c90e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:55:59.584951 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-977f0e8d-43f8-450d-8cc8-4c5ca96c90e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:59.585683 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-977f0e8d-43f8-450d-8cc8-4c5ca96c90e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:59.586666 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-977f0e8d-43f8-450d-8cc8-4c5ca96c90e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:59.587300 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-977f0e8d-43f8-450d-8cc8-4c5ca96c90e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:59.623364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-977f0e8d-43f8-450d-8cc8-4c5ca96c90e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:55:59.623911 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-977f0e8d-43f8-450d-8cc8-4c5ca96c90e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:55:59.624691 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-977f0e8d-43f8-450d-8cc8-4c5ca96c90e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lazy-loading 'fault' on Instance uuid a40e1f19-e3f4-4bc2-96d5-711703b48a28 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:55:59.695712 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-977f0e8d-43f8-450d-8cc8-4c5ca96c90e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:59.704264 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-977f0e8d-43f8-450d-8cc8-4c5ca96c90e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 200 len: 1331 microversion: 2.1 time: 0.140939 Jul 27 07:55:59.715513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 398/775] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:59 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 1331 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:55:59.758098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-81fdfe86-8c57-4a97-bdff-7cd10b53a10c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:55:59.774097 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-81fdfe86-8c57-4a97-bdff-7cd10b53a10c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1677 microversion: 2.1 time: 0.233943 Jul 27 07:55:59.774688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 378/776] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:55:59 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1677 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:00.727883 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e5f02610-a708-4ffc-bb65-d07501055647 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:00.728420 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e5f02610-a708-4ffc-bb65-d07501055647 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:00.735142 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e5f02610-a708-4ffc-bb65-d07501055647 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:00.735595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e5f02610-a708-4ffc-bb65-d07501055647 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:00.736361 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e5f02610-a708-4ffc-bb65-d07501055647 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:00.736801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e5f02610-a708-4ffc-bb65-d07501055647 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:00.750027 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-e5f02610-a708-4ffc-bb65-d07501055647 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] HTTP exception thrown: Instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 could not be found. Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e5f02610-a708-4ffc-bb65-d07501055647 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Request method failure captured: Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 HTTP/1.1 Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O4dQ6_Byd_TD8xXq_XrmoAr0FnlxsHKbwgQB4VAdIj5jmoqqdcTwHdIHCz-P_Xc5D3ADlxoxXrDt03El4_T3pb-Ot48U5BPQM4YOeGwU-aBen5Ed5125zCHbhJWC6gPVYWV7POipX99mXjlK6dYXCdPUlOB_d-CTA6UDGcIc4XpxPg Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 07:56:00.751699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 07:56:00.753273 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:56:00.753273 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 07:56:00.753273 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 07:56:00.753273 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 07:56:00.753273 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 07:56:00.753273 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 07:56:00.753273 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 07:56:00.753273 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: df8fb928aa42413b9d03e83f46dd48bc Jul 27 07:56:00.753273 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 07:56:00.753273 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 07:56:00.753273 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 could not be found. Jul 27 07:56:00.753273 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': 'a40e1f19-e3f4-4bc2-96d5-711703b48a28'} Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 could not be found. Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:56:00.754387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:56:00.756005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:56:00.756005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 07:56:00.756005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 07:56:00.756005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 07:56:00.756005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 07:56:00.756005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 07:56:00.756005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:56:00.756005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 could not be found. Jul 27 07:56:00.756005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:00.756005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:56:00.756005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:00.756005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:56:00.756005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:56:00.756005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:56:00.756005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:56:00.756005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:56:00.756005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 could not be found. Jul 27 07:56:00.756005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:00.757720 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e5f02610-a708-4ffc-bb65-d07501055647 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Returning 404 to user: Instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:56:00.757720 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e5f02610-a708-4ffc-bb65-d07501055647 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 404 len: 111 microversion: 2.1 time: 0.029898 Jul 27 07:56:00.757720 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 399/777] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:00 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 07:56:00.761860 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-02b8c091-3e18-4551-94d3-4fcb19c350bb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '.version_select at 0x7f19fe51c3a0>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:00.782222 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-02b8c091-3e18-4551-94d3-4fcb19c350bb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-896920266" status: 202 len: 0 microversion: 2.1 time: 0.024022 Jul 27 07:56:00.782814 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 379/778] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Jul 27 07:56:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-896920266 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 07:56:00.796317 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0c339d46-3bf3-410d-aeeb-327f73610170 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:00.796924 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0c339d46-3bf3-410d-aeeb-327f73610170 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:00.803120 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0c339d46-3bf3-410d-aeeb-327f73610170 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:00.803654 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0c339d46-3bf3-410d-aeeb-327f73610170 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:00.804441 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0c339d46-3bf3-410d-aeeb-327f73610170 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:00.804877 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0c339d46-3bf3-410d-aeeb-327f73610170 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:01.000185 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0c339d46-3bf3-410d-aeeb-327f73610170 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:01.008673 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0c339d46-3bf3-410d-aeeb-327f73610170 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1677 microversion: 2.1 time: 0.216490 Jul 27 07:56:01.009399 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 400/779] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:00 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:01.556799 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-6e9c1a5e-37f6-412d-9d3c-234b12fa53c1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:01.557323 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-6e9c1a5e-37f6-412d-9d3c-234b12fa53c1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:01.564051 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6e9c1a5e-37f6-412d-9d3c-234b12fa53c1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:01.564505 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6e9c1a5e-37f6-412d-9d3c-234b12fa53c1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:01.565305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6e9c1a5e-37f6-412d-9d3c-234b12fa53c1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:01.565748 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6e9c1a5e-37f6-412d-9d3c-234b12fa53c1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:01.655507 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.objects.instance [None req-6e9c1a5e-37f6-412d-9d3c-234b12fa53c1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lazy-loading 'services' on Instance uuid 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 {{(pid=117779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:56:01.769910 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-6e9c1a5e-37f6-412d-9d3c-234b12fa53c1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6/os-volume_attachments/b23a632d-7382-4c14-ab62-17c1ea042e0e" status: 202 len: 0 microversion: 2.1 time: 0.217682 Jul 27 07:56:01.770559 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 380/780] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Jul 27 07:56:01 2022] DELETE /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6/os-volume_attachments/b23a632d-7382-4c14-ab62-17c1ea042e0e => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 07:56:01.779405 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-60662520-ae2e-44f9-a1da-52c92d792533 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:01.781663 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-60662520-ae2e-44f9-a1da-52c92d792533 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:01.788274 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-60662520-ae2e-44f9-a1da-52c92d792533 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:01.788728 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-60662520-ae2e-44f9-a1da-52c92d792533 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:01.789502 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-60662520-ae2e-44f9-a1da-52c92d792533 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:01.789939 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-60662520-ae2e-44f9-a1da-52c92d792533 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:01.820316 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-60662520-ae2e-44f9-a1da-52c92d792533 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044812 Jul 27 07:56:01.820896 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 401/781] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:56:01 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:56:02.030354 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0853859e-f1eb-47f7-880d-824661c5b297 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:02.030991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0853859e-f1eb-47f7-880d-824661c5b297 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:02.037234 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0853859e-f1eb-47f7-880d-824661c5b297 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:02.037675 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0853859e-f1eb-47f7-880d-824661c5b297 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:02.038432 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0853859e-f1eb-47f7-880d-824661c5b297 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:02.038866 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0853859e-f1eb-47f7-880d-824661c5b297 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:02.171565 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0853859e-f1eb-47f7-880d-824661c5b297 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:02.179464 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0853859e-f1eb-47f7-880d-824661c5b297 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1677 microversion: 2.1 time: 0.153405 Jul 27 07:56:02.180019 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 381/782] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:02 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:02.833709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-34862b12-c9d2-400e-8e63-e9d15da51e81 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:02.835900 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-34862b12-c9d2-400e-8e63-e9d15da51e81 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:02.838382 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:02.844034 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-34862b12-c9d2-400e-8e63-e9d15da51e81 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:02.844480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-34862b12-c9d2-400e-8e63-e9d15da51e81 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:02.845245 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-34862b12-c9d2-400e-8e63-e9d15da51e81 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:02.845676 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-34862b12-c9d2-400e-8e63-e9d15da51e81 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:02.880014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-34862b12-c9d2-400e-8e63-e9d15da51e81 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047004 Jul 27 07:56:02.880014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 402/783] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:56:02 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:56:03.200534 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-3b9818c9-aec3-48a0-bbf3-a76618e9776d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:03.201092 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-3b9818c9-aec3-48a0-bbf3-a76618e9776d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:03.207546 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3b9818c9-aec3-48a0-bbf3-a76618e9776d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:03.207973 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3b9818c9-aec3-48a0-bbf3-a76618e9776d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:03.209304 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3b9818c9-aec3-48a0-bbf3-a76618e9776d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:03.209727 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3b9818c9-aec3-48a0-bbf3-a76618e9776d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:03.349432 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3b9818c9-aec3-48a0-bbf3-a76618e9776d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:03.358189 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-3b9818c9-aec3-48a0-bbf3-a76618e9776d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1677 microversion: 2.1 time: 0.161518 Jul 27 07:56:03.358779 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 382/784] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:03 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:03.888900 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ded4f766-31c2-4a89-a934-91008aa753d3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:03.891114 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ded4f766-31c2-4a89-a934-91008aa753d3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:03.897670 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ded4f766-31c2-4a89-a934-91008aa753d3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:03.898120 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ded4f766-31c2-4a89-a934-91008aa753d3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:03.898901 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ded4f766-31c2-4a89-a934-91008aa753d3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:03.899362 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ded4f766-31c2-4a89-a934-91008aa753d3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:03.901734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:03.931418 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ded4f766-31c2-4a89-a934-91008aa753d3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046458 Jul 27 07:56:03.931979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 403/785] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:56:03 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 07:56:03.993731 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a5a5094e-e452-4661-9a04-be9ae2a1eebf tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:03.994224 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a5a5094e-e452-4661-9a04-be9ae2a1eebf tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:04.000268 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a5a5094e-e452-4661-9a04-be9ae2a1eebf tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:04.000799 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a5a5094e-e452-4661-9a04-be9ae2a1eebf tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:04.001666 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a5a5094e-e452-4661-9a04-be9ae2a1eebf tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:04.002104 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a5a5094e-e452-4661-9a04-be9ae2a1eebf tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:04.027206 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a5a5094e-e452-4661-9a04-be9ae2a1eebf tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Going to try to terminate instance {{(pid=117779) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 07:56:04.103800 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a5a5094e-e452-4661-9a04-be9ae2a1eebf tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 204 len: 0 microversion: 2.1 time: 0.113593 Jul 27 07:56:04.104583 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 383/786] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 07:56:03 2022] DELETE /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 07:56:04.112450 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b0ac9bfa-3597-47eb-a157-1666862428d2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:04.113109 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b0ac9bfa-3597-47eb-a157-1666862428d2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:04.119219 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b0ac9bfa-3597-47eb-a157-1666862428d2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:04.119665 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b0ac9bfa-3597-47eb-a157-1666862428d2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:04.120425 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b0ac9bfa-3597-47eb-a157-1666862428d2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:04.120860 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b0ac9bfa-3597-47eb-a157-1666862428d2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:04.264965 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b0ac9bfa-3597-47eb-a157-1666862428d2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:04.274569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b0ac9bfa-3597-47eb-a157-1666862428d2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1683 microversion: 2.1 time: 0.165855 Jul 27 07:56:04.275247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 404/787] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:04 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:04.382329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b491e838-9eaf-4b8d-8441-5cf8df3b90f3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:04.383041 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b491e838-9eaf-4b8d-8441-5cf8df3b90f3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:04.389502 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b491e838-9eaf-4b8d-8441-5cf8df3b90f3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:04.389943 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b491e838-9eaf-4b8d-8441-5cf8df3b90f3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:04.390695 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b491e838-9eaf-4b8d-8441-5cf8df3b90f3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:04.391151 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b491e838-9eaf-4b8d-8441-5cf8df3b90f3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:04.519766 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b491e838-9eaf-4b8d-8441-5cf8df3b90f3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:04.527950 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b491e838-9eaf-4b8d-8441-5cf8df3b90f3 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1677 microversion: 2.1 time: 0.150939 Jul 27 07:56:04.528522 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 384/788] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:04 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:05.306121 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fff79e7a-81f8-4580-b94d-2db203a22839 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:05.306738 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fff79e7a-81f8-4580-b94d-2db203a22839 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:05.313248 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fff79e7a-81f8-4580-b94d-2db203a22839 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:05.313690 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fff79e7a-81f8-4580-b94d-2db203a22839 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:05.314459 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fff79e7a-81f8-4580-b94d-2db203a22839 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:05.314913 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fff79e7a-81f8-4580-b94d-2db203a22839 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:05.446447 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fff79e7a-81f8-4580-b94d-2db203a22839 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:05.454656 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fff79e7a-81f8-4580-b94d-2db203a22839 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1683 microversion: 2.1 time: 0.152999 Jul 27 07:56:05.455259 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 405/789] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:05 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:05.549803 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-609bd8a2-465a-4725-b646-747f926651b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:05.550532 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-609bd8a2-465a-4725-b646-747f926651b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:05.556941 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-609bd8a2-465a-4725-b646-747f926651b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:05.557390 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-609bd8a2-465a-4725-b646-747f926651b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:05.558157 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-609bd8a2-465a-4725-b646-747f926651b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:05.558597 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-609bd8a2-465a-4725-b646-747f926651b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:06.053255 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-609bd8a2-465a-4725-b646-747f926651b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:06.061126 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-609bd8a2-465a-4725-b646-747f926651b8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1677 microversion: 2.1 time: 0.515330 Jul 27 07:56:06.061711 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 385/790] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:05 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1677 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:06.356365 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-d521a361-1e08-481b-b666-e61423b9cff7 req-8e4419b9-510e-4141-97f0-2097fafe6b78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6", "name": "network-vif-deleted", "tag": "049be348-8604-49d4-9257-b55b2d5b98fd"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:56:06.367210 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-d521a361-1e08-481b-b666-e61423b9cff7 req-8e4419b9-510e-4141-97f0-2097fafe6b78 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:06.367658 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-d521a361-1e08-481b-b666-e61423b9cff7 req-8e4419b9-510e-4141-97f0-2097fafe6b78 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:06.379285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-d521a361-1e08-481b-b666-e61423b9cff7 req-8e4419b9-510e-4141-97f0-2097fafe6b78 service nova] Creating event network-vif-deleted:049be348-8604-49d4-9257-b55b2d5b98fd for instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 on hv-cinder-82549 Jul 27 07:56:06.384403 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-d521a361-1e08-481b-b666-e61423b9cff7 req-8e4419b9-510e-4141-97f0-2097fafe6b78 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031533 Jul 27 07:56:06.385299 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 406/791] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:56:06.477119 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-18da0ea4-47f7-461a-9f17-27f58b12f8e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:06.478115 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-18da0ea4-47f7-461a-9f17-27f58b12f8e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:06.484926 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-18da0ea4-47f7-461a-9f17-27f58b12f8e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:06.485363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-18da0ea4-47f7-461a-9f17-27f58b12f8e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:06.486226 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-18da0ea4-47f7-461a-9f17-27f58b12f8e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:06.486730 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-18da0ea4-47f7-461a-9f17-27f58b12f8e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:06.521670 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-18da0ea4-47f7-461a-9f17-27f58b12f8e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:06.522827 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-18da0ea4-47f7-461a-9f17-27f58b12f8e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:06.522827 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.objects.instance [None req-18da0ea4-47f7-461a-9f17-27f58b12f8e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lazy-loading 'fault' on Instance uuid 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 {{(pid=117779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:56:06.530960 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:06.574305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-18da0ea4-47f7-461a-9f17-27f58b12f8e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:06.582862 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-18da0ea4-47f7-461a-9f17-27f58b12f8e1 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 200 len: 1331 microversion: 2.1 time: 0.110381 Jul 27 07:56:06.583964 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 386/792] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:06 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:07.083306 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-284333fb-d65d-4718-8c9e-e4747c5e73b4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:07.084255 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-284333fb-d65d-4718-8c9e-e4747c5e73b4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:07.092449 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-284333fb-d65d-4718-8c9e-e4747c5e73b4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:07.092908 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-284333fb-d65d-4718-8c9e-e4747c5e73b4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:07.093775 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-284333fb-d65d-4718-8c9e-e4747c5e73b4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:07.094394 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-284333fb-d65d-4718-8c9e-e4747c5e73b4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:07.236487 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-284333fb-d65d-4718-8c9e-e4747c5e73b4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:07.244751 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-284333fb-d65d-4718-8c9e-e4747c5e73b4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1677 microversion: 2.1 time: 0.166169 Jul 27 07:56:07.245340 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 407/793] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:07 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:07.604933 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-4f18fe11-b7d5-4fbd-a1b2-27c645108241 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:07.605548 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-4f18fe11-b7d5-4fbd-a1b2-27c645108241 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:07.613365 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4f18fe11-b7d5-4fbd-a1b2-27c645108241 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:07.613919 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4f18fe11-b7d5-4fbd-a1b2-27c645108241 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:07.614861 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4f18fe11-b7d5-4fbd-a1b2-27c645108241 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:07.615391 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4f18fe11-b7d5-4fbd-a1b2-27c645108241 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:07.631457 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-4f18fe11-b7d5-4fbd-a1b2-27c645108241 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] HTTP exception thrown: Instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 could not be found. Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-4f18fe11-b7d5-4fbd-a1b2-27c645108241 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Request method failure captured: Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 HTTP/1.1 Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O4dQ6_Byd_TD8xXq_XrmoAr0FnlxsHKbwgQB4VAdIj5jmoqqdcTwHdIHCz-P_Xc5D3ADlxoxXrDt03El4_T3pb-Ot48U5BPQM4YOeGwU-aBen5Ed5125zCHbhJWC6gPVYWV7POipX99mXjlK6dYXCdPUlOB_d-CTA6UDGcIc4XpxPg Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 07:56:07.633105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 07:56:07.634724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:56:07.634724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 07:56:07.634724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 07:56:07.634724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 07:56:07.634724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 07:56:07.634724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 07:56:07.634724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 07:56:07.634724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: df8fb928aa42413b9d03e83f46dd48bc Jul 27 07:56:07.634724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 07:56:07.634724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 07:56:07.634724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 could not be found. Jul 27 07:56:07.634724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': '2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6'} Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 could not be found. Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:56:07.635557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:56:07.636947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:56:07.636947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 07:56:07.636947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 07:56:07.636947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 07:56:07.636947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 07:56:07.636947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 07:56:07.636947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:56:07.636947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 could not be found. Jul 27 07:56:07.636947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:56:07.636947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:56:07.636947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:56:07.636947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:56:07.636947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:56:07.636947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:56:07.636947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:56:07.636947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:56:07.636947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 could not be found. Jul 27 07:56:07.636947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:56:07.638176 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-4f18fe11-b7d5-4fbd-a1b2-27c645108241 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Returning 404 to user: Instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:56:07.638176 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-4f18fe11-b7d5-4fbd-a1b2-27c645108241 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 404 len: 111 microversion: 2.1 time: 0.033503 Jul 27 07:56:07.638176 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 387/794] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:07 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 07:56:07.643538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c6447ede-77bd-4cef-a18a-f6726fb738e5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '.version_select at 0x7f1a02c56d30>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:07.664272 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c6447ede-77bd-4cef-a18a-f6726fb738e5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-353337677" status: 202 len: 0 microversion: 2.1 time: 0.024467 Jul 27 07:56:07.664863 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 408/795] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Jul 27 07:56:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-353337677 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 07:56:08.266545 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c61ad4c9-c3ca-4557-b5d7-a00c1b74f197 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:08.267189 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c61ad4c9-c3ca-4557-b5d7-a00c1b74f197 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:08.273620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c61ad4c9-c3ca-4557-b5d7-a00c1b74f197 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:08.273997 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c61ad4c9-c3ca-4557-b5d7-a00c1b74f197 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:08.274759 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c61ad4c9-c3ca-4557-b5d7-a00c1b74f197 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:08.275546 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c61ad4c9-c3ca-4557-b5d7-a00c1b74f197 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:08.334913 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fefc1af0-9eb2-4052-a4e7-809fd5c14e28 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Action: 'create', calling method: .version_select at 0x7f1a02bf2b80>, body: {"keypair": {"name": "tempest-keypair-1845839791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVC/FfwvhnaFIZslkGyL5VGzakfmvrZTK8Um6s6blP/ehhN/ff88iwlD+uVcVvctYDPMCGw30MWxjWmt2+vBnXihTy60UW0GbDkAwnlGYwbW5/PTgr/V7oqkNDlRypZ4Q=="}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:56:08.351905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-fefc1af0-9eb2-4052-a4e7-809fd5c14e28 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Getting quotas for project 1cabcb825ebe4430a7ffa759d5e53d2f. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:56:08.356157 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-fefc1af0-9eb2-4052-a4e7-809fd5c14e28 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Getting quotas for user df8fb928aa42413b9d03e83f46dd48bc and project 1cabcb825ebe4430a7ffa759d5e53d2f. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:56:08.378183 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fefc1af0-9eb2-4052-a4e7-809fd5c14e28 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047161 Jul 27 07:56:08.378995 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 409/796] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Jul 27 07:56:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:56:08.422164 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c61ad4c9-c3ca-4557-b5d7-a00c1b74f197 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:08.431069 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c61ad4c9-c3ca-4557-b5d7-a00c1b74f197 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1654 microversion: 2.1 time: 0.168659 Jul 27 07:56:08.431870 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 388/797] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:08 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1654 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:08.452131 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-99f96318-1d29-4dad-ad47-39d36be7a6ef tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:56:08.458551 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-99f96318-1d29-4dad-ad47-39d36be7a6ef tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:08.459062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-99f96318-1d29-4dad-ad47-39d36be7a6ef tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:08.482697 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-99f96318-1d29-4dad-ad47-39d36be7a6ef tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Going to try to start instance {{(pid=117780) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 27 07:56:08.531712 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-99f96318-1d29-4dad-ad47-39d36be7a6ef tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "POST /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979/action" status: 202 len: 0 microversion: 2.1 time: 0.083259 Jul 27 07:56:08.532696 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 410/798] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Jul 27 07:56:08 2022] POST /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 07:56:08.548724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e5d9a300-496e-48b1-a1c0-b0dd5841e71a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:08.549352 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e5d9a300-496e-48b1-a1c0-b0dd5841e71a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:08.561376 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e5d9a300-496e-48b1-a1c0-b0dd5841e71a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:08.561832 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e5d9a300-496e-48b1-a1c0-b0dd5841e71a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:08.562612 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e5d9a300-496e-48b1-a1c0-b0dd5841e71a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:08.563260 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e5d9a300-496e-48b1-a1c0-b0dd5841e71a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:08.799870 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e5d9a300-496e-48b1-a1c0-b0dd5841e71a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:08.813637 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e5d9a300-496e-48b1-a1c0-b0dd5841e71a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1663 microversion: 2.1 time: 0.274511 Jul 27 07:56:08.815984 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 389/799] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:08 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1663 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:09.838779 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-935d603e-4f2a-434a-afb5-28623d95467e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:09.839512 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-935d603e-4f2a-434a-afb5-28623d95467e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:09.847104 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-935d603e-4f2a-434a-afb5-28623d95467e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:09.849647 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-935d603e-4f2a-434a-afb5-28623d95467e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:09.850470 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-935d603e-4f2a-434a-afb5-28623d95467e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:09.850950 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-935d603e-4f2a-434a-afb5-28623d95467e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:10.049879 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-935d603e-4f2a-434a-afb5-28623d95467e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:10.058108 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-935d603e-4f2a-434a-afb5-28623d95467e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1663 microversion: 2.1 time: 0.223613 Jul 27 07:56:10.058670 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 411/800] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:09 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1663 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:10.071543 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-00c360f5-acea-4136-b8e5-f7608d5cc492 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-471012181", "imageRef": "646bfb5d-ef25-404a-a432-35d4209840fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2524cead-0094-4b3d-89eb-61da848d7e54"}], "security_groups": [{"name": "tempest-securitygroup--136212671"}], "key_name": "tempest-keypair-1845839791", "user_data": "}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:56:10.173992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.network.neutron [None req-00c360f5-acea-4136-b8e5-f7608d5cc492 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] validate_networks() for [('2524cead-0094-4b3d-89eb-61da848d7e54', None, None, None, None, None)] {{(pid=117779) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:56:10.568927 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-00c360f5-acea-4136-b8e5-f7608d5cc492 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Flavor limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:56:10.569350 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-00c360f5-acea-4136-b8e5-f7608d5cc492 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Image limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:56:10.569831 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-00c360f5-acea-4136-b8e5-f7608d5cc492 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Flavor pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:56:10.570245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-00c360f5-acea-4136-b8e5-f7608d5cc492 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Image pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:56:10.570655 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-00c360f5-acea-4136-b8e5-f7608d5cc492 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:56:10.579529 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-00c360f5-acea-4136-b8e5-f7608d5cc492 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:10.579976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-00c360f5-acea-4136-b8e5-f7608d5cc492 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:10.580784 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-00c360f5-acea-4136-b8e5-f7608d5cc492 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:10.581222 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-00c360f5-acea-4136-b8e5-f7608d5cc492 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:10.598026 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-00c360f5-acea-4136-b8e5-f7608d5cc492 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Getting quotas for project 1cabcb825ebe4430a7ffa759d5e53d2f. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:56:10.602514 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-00c360f5-acea-4136-b8e5-f7608d5cc492 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Getting quotas for user df8fb928aa42413b9d03e83f46dd48bc and project 1cabcb825ebe4430a7ffa759d5e53d2f. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:56:10.613606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-00c360f5-acea-4136-b8e5-f7608d5cc492 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Going to run 1 instances... {{(pid=117779) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:56:10.616538 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-00c360f5-acea-4136-b8e5-f7608d5cc492 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='646bfb5d-ef25-404a-a432-35d4209840fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:56:10.663581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-00c360f5-acea-4136-b8e5-f7608d5cc492 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.596741 Jul 27 07:56:10.664531 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 390/801] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 07:56:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 07:56:10.675125 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8c0a830f-f42a-4380-a771-20069344e969 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:10.675786 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8c0a830f-f42a-4380-a771-20069344e969 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:10.729777 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8c0a830f-f42a-4380-a771-20069344e969 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:10.736519 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8c0a830f-f42a-4380-a771-20069344e969 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 200 len: 1241 microversion: 2.1 time: 0.065270 Jul 27 07:56:10.737115 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 412/802] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:10 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:11.080443 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-dc0a6188-6d40-4b94-946c-02cf461728ec tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:11.081067 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-dc0a6188-6d40-4b94-946c-02cf461728ec tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:11.089039 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dc0a6188-6d40-4b94-946c-02cf461728ec tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:11.089477 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dc0a6188-6d40-4b94-946c-02cf461728ec tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:11.090239 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dc0a6188-6d40-4b94-946c-02cf461728ec tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:11.090665 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dc0a6188-6d40-4b94-946c-02cf461728ec tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:11.227290 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-dc0a6188-6d40-4b94-946c-02cf461728ec tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:11.236123 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-dc0a6188-6d40-4b94-946c-02cf461728ec tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1667 microversion: 2.1 time: 0.159235 Jul 27 07:56:11.236123 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 391/803] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:11 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1667 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:11.759134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-dbd8c0da-3e48-4803-beef-288f87b75dd7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:11.759744 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-dbd8c0da-3e48-4803-beef-288f87b75dd7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:11.767018 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dbd8c0da-3e48-4803-beef-288f87b75dd7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:11.767737 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dbd8c0da-3e48-4803-beef-288f87b75dd7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:11.768510 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dbd8c0da-3e48-4803-beef-288f87b75dd7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:11.769295 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dbd8c0da-3e48-4803-beef-288f87b75dd7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:11.841124 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-dbd8c0da-3e48-4803-beef-288f87b75dd7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:11.849560 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-dbd8c0da-3e48-4803-beef-288f87b75dd7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 200 len: 1311 microversion: 2.1 time: 0.095690 Jul 27 07:56:11.850158 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 413/804] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:11 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:12.871340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ff88c2e9-7d0f-4fcc-9975-90d782b4df73 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:12.871858 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ff88c2e9-7d0f-4fcc-9975-90d782b4df73 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:12.878499 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ff88c2e9-7d0f-4fcc-9975-90d782b4df73 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:12.878993 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ff88c2e9-7d0f-4fcc-9975-90d782b4df73 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:12.879789 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ff88c2e9-7d0f-4fcc-9975-90d782b4df73 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:12.880721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ff88c2e9-7d0f-4fcc-9975-90d782b4df73 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:13.068732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ff88c2e9-7d0f-4fcc-9975-90d782b4df73 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:13.076620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ff88c2e9-7d0f-4fcc-9975-90d782b4df73 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 200 len: 1366 microversion: 2.1 time: 0.209564 Jul 27 07:56:13.077208 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 392/805] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:12 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:56:13.416504 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-98729f1e-4e5c-40af-b0e7-ea326b094014 req-36cfe874-e645-4d81-8210-117a4fca69c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a66de7de-7505-4ee5-bf1f-ce3608663e6f", "tag": "32407fa9-c995-4bfe-b8d6-9beb17542453"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:56:13.440932 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-98729f1e-4e5c-40af-b0e7-ea326b094014 req-36cfe874-e645-4d81-8210-117a4fca69c2 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:13.441489 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-98729f1e-4e5c-40af-b0e7-ea326b094014 req-36cfe874-e645-4d81-8210-117a4fca69c2 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:13.453821 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-98729f1e-4e5c-40af-b0e7-ea326b094014 req-36cfe874-e645-4d81-8210-117a4fca69c2 service nova] Creating event network-changed:32407fa9-c995-4bfe-b8d6-9beb17542453 for instance a66de7de-7505-4ee5-bf1f-ce3608663e6f on hv-cinder-82549 Jul 27 07:56:13.460285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-98729f1e-4e5c-40af-b0e7-ea326b094014 req-36cfe874-e645-4d81-8210-117a4fca69c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047715 Jul 27 07:56:13.461541 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 414/806] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:56:14.098604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0cca165e-ff5a-454d-b495-3961acc09f89 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:14.099818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0cca165e-ff5a-454d-b495-3961acc09f89 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:14.105976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0cca165e-ff5a-454d-b495-3961acc09f89 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:14.106421 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0cca165e-ff5a-454d-b495-3961acc09f89 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:14.107209 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0cca165e-ff5a-454d-b495-3961acc09f89 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:14.107647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0cca165e-ff5a-454d-b495-3961acc09f89 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:14.237639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0cca165e-ff5a-454d-b495-3961acc09f89 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:14.245673 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0cca165e-ff5a-454d-b495-3961acc09f89 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 200 len: 1366 microversion: 2.1 time: 0.151402 Jul 27 07:56:14.246308 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 393/807] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:14 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:15.267681 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-74843640-6dcc-470a-a71b-10c962fb7ead tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:15.268383 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-74843640-6dcc-470a-a71b-10c962fb7ead tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:15.275416 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-74843640-6dcc-470a-a71b-10c962fb7ead tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:15.275903 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-74843640-6dcc-470a-a71b-10c962fb7ead tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:15.276707 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-74843640-6dcc-470a-a71b-10c962fb7ead tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:15.277182 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-74843640-6dcc-470a-a71b-10c962fb7ead tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:15.410711 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-74843640-6dcc-470a-a71b-10c962fb7ead tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:15.418141 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-74843640-6dcc-470a-a71b-10c962fb7ead tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 200 len: 1366 microversion: 2.1 time: 0.155243 Jul 27 07:56:15.418741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 415/808] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:15 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:16.439578 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-bf47e700-299e-4466-964e-d6f441bad1dc tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:16.440225 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-bf47e700-299e-4466-964e-d6f441bad1dc tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:16.448038 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bf47e700-299e-4466-964e-d6f441bad1dc tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:16.448490 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bf47e700-299e-4466-964e-d6f441bad1dc tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:16.449260 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bf47e700-299e-4466-964e-d6f441bad1dc tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:16.449699 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bf47e700-299e-4466-964e-d6f441bad1dc tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:16.576181 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-bf47e700-299e-4466-964e-d6f441bad1dc tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:16.583632 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-bf47e700-299e-4466-964e-d6f441bad1dc tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 200 len: 1366 microversion: 2.1 time: 0.147894 Jul 27 07:56:16.584197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 394/809] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:16 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:17.605092 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1704d29b-3c7f-4c29-b7e2-2e91ff5d431b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:17.605625 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1704d29b-3c7f-4c29-b7e2-2e91ff5d431b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:17.612447 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1704d29b-3c7f-4c29-b7e2-2e91ff5d431b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:17.612898 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1704d29b-3c7f-4c29-b7e2-2e91ff5d431b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:17.613671 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1704d29b-3c7f-4c29-b7e2-2e91ff5d431b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:17.614112 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1704d29b-3c7f-4c29-b7e2-2e91ff5d431b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:17.745618 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1704d29b-3c7f-4c29-b7e2-2e91ff5d431b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:17.753195 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1704d29b-3c7f-4c29-b7e2-2e91ff5d431b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 200 len: 1366 microversion: 2.1 time: 0.152127 Jul 27 07:56:17.753766 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 416/810] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:17 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:18.773823 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-bd78b8a8-2d35-4363-8600-024d8c55fac7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:18.774344 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-bd78b8a8-2d35-4363-8600-024d8c55fac7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:18.780953 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bd78b8a8-2d35-4363-8600-024d8c55fac7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:18.781404 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bd78b8a8-2d35-4363-8600-024d8c55fac7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:18.782165 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bd78b8a8-2d35-4363-8600-024d8c55fac7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:18.782604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bd78b8a8-2d35-4363-8600-024d8c55fac7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:18.920179 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-bd78b8a8-2d35-4363-8600-024d8c55fac7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:18.928224 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-bd78b8a8-2d35-4363-8600-024d8c55fac7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 200 len: 1366 microversion: 2.1 time: 0.158331 Jul 27 07:56:18.928787 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 395/811] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:18 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:19.949098 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fac40f3e-ec52-4df8-8bda-dc6903397a57 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:19.949713 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fac40f3e-ec52-4df8-8bda-dc6903397a57 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:19.956343 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fac40f3e-ec52-4df8-8bda-dc6903397a57 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:19.956823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fac40f3e-ec52-4df8-8bda-dc6903397a57 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:19.957591 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fac40f3e-ec52-4df8-8bda-dc6903397a57 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:19.958028 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fac40f3e-ec52-4df8-8bda-dc6903397a57 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:20.088977 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fac40f3e-ec52-4df8-8bda-dc6903397a57 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:20.096417 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fac40f3e-ec52-4df8-8bda-dc6903397a57 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 200 len: 1366 microversion: 2.1 time: 0.151186 Jul 27 07:56:20.096981 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 417/812] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:19 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:21.117472 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-451a0706-5691-4c09-be19-ba866fa4bc18 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:21.118068 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-451a0706-5691-4c09-be19-ba866fa4bc18 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:21.120363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=2 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:21.121126 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=6 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:21.127210 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-451a0706-5691-4c09-be19-ba866fa4bc18 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:21.127652 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-451a0706-5691-4c09-be19-ba866fa4bc18 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:21.128414 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-451a0706-5691-4c09-be19-ba866fa4bc18 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:21.128840 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-451a0706-5691-4c09-be19-ba866fa4bc18 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:21.258229 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-451a0706-5691-4c09-be19-ba866fa4bc18 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:21.265775 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-451a0706-5691-4c09-be19-ba866fa4bc18 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 200 len: 1366 microversion: 2.1 time: 0.151969 Jul 27 07:56:21.266612 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 396/813] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:21 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:21.766053 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=6 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:21.825159 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-a7be76f9-72c6-4e34-830d-9437c3f044db req-d9439808-c2f6-4833-bb87-7ea1811e1e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66de7de-7505-4ee5-bf1f-ce3608663e6f", "name": "network-vif-plugged", "status": "completed", "tag": "32407fa9-c995-4bfe-b8d6-9beb17542453"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:56:21.835953 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-a7be76f9-72c6-4e34-830d-9437c3f044db req-d9439808-c2f6-4833-bb87-7ea1811e1e9b service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:21.836415 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-a7be76f9-72c6-4e34-830d-9437c3f044db req-d9439808-c2f6-4833-bb87-7ea1811e1e9b service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:21.847888 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-a7be76f9-72c6-4e34-830d-9437c3f044db req-d9439808-c2f6-4833-bb87-7ea1811e1e9b service nova] Creating event network-vif-plugged:32407fa9-c995-4bfe-b8d6-9beb17542453 for instance a66de7de-7505-4ee5-bf1f-ce3608663e6f on hv-cinder-82549 Jul 27 07:56:21.853108 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-a7be76f9-72c6-4e34-830d-9437c3f044db req-d9439808-c2f6-4833-bb87-7ea1811e1e9b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091886 Jul 27 07:56:21.853700 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 418/814] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:56:22.288342 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e96561e4-838c-4239-bb12-416f3608a0db tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:22.289021 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e96561e4-838c-4239-bb12-416f3608a0db tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:22.295502 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e96561e4-838c-4239-bb12-416f3608a0db tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:22.295946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e96561e4-838c-4239-bb12-416f3608a0db tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:22.296704 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e96561e4-838c-4239-bb12-416f3608a0db tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:22.297131 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e96561e4-838c-4239-bb12-416f3608a0db tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:22.428524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e96561e4-838c-4239-bb12-416f3608a0db tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:22.436503 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e96561e4-838c-4239-bb12-416f3608a0db tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 200 len: 1366 microversion: 2.1 time: 0.152605 Jul 27 07:56:22.437103 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 397/815] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:22 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:23.464909 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ac1beb8c-6f7d-4e98-a7ed-fd9b947a5b58 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:23.465663 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ac1beb8c-6f7d-4e98-a7ed-fd9b947a5b58 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:23.471962 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ac1beb8c-6f7d-4e98-a7ed-fd9b947a5b58 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:23.472681 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ac1beb8c-6f7d-4e98-a7ed-fd9b947a5b58 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:23.473450 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ac1beb8c-6f7d-4e98-a7ed-fd9b947a5b58 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:23.473959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ac1beb8c-6f7d-4e98-a7ed-fd9b947a5b58 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:23.609589 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ac1beb8c-6f7d-4e98-a7ed-fd9b947a5b58 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:23.617078 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ac1beb8c-6f7d-4e98-a7ed-fd9b947a5b58 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 200 len: 1366 microversion: 2.1 time: 0.157164 Jul 27 07:56:23.617647 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 419/816] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:23 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:24.637977 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-48f3fc15-ea8a-4e2e-af05-701642892f59 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:24.638598 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-48f3fc15-ea8a-4e2e-af05-701642892f59 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:24.645139 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-48f3fc15-ea8a-4e2e-af05-701642892f59 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:24.645588 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-48f3fc15-ea8a-4e2e-af05-701642892f59 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:24.646360 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-48f3fc15-ea8a-4e2e-af05-701642892f59 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:24.646796 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-48f3fc15-ea8a-4e2e-af05-701642892f59 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:24.775892 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-48f3fc15-ea8a-4e2e-af05-701642892f59 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:24.783416 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-48f3fc15-ea8a-4e2e-af05-701642892f59 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 200 len: 1366 microversion: 2.1 time: 0.149428 Jul 27 07:56:24.783990 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 398/817] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:24 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:25.804673 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1ce3176c-f57c-4c0e-93e9-cddfc212216f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:25.805240 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1ce3176c-f57c-4c0e-93e9-cddfc212216f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:25.812078 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1ce3176c-f57c-4c0e-93e9-cddfc212216f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:25.812531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1ce3176c-f57c-4c0e-93e9-cddfc212216f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:25.813301 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1ce3176c-f57c-4c0e-93e9-cddfc212216f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:25.813742 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1ce3176c-f57c-4c0e-93e9-cddfc212216f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:25.947548 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1ce3176c-f57c-4c0e-93e9-cddfc212216f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:25.954928 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1ce3176c-f57c-4c0e-93e9-cddfc212216f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 200 len: 1557 microversion: 2.1 time: 0.154216 Jul 27 07:56:25.955488 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 420/818] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:25 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:25.975728 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a88af2c5-20c1-4169-99a2-2562230dd051 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:25.976239 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a88af2c5-20c1-4169-99a2-2562230dd051 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:25.982626 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a88af2c5-20c1-4169-99a2-2562230dd051 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:25.983126 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a88af2c5-20c1-4169-99a2-2562230dd051 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:25.983869 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a88af2c5-20c1-4169-99a2-2562230dd051 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:25.984295 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a88af2c5-20c1-4169-99a2-2562230dd051 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:26.065200 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a88af2c5-20c1-4169-99a2-2562230dd051 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094348 Jul 27 07:56:26.065829 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 399/819] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Jul 27 07:56:25 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:56:27.273483 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-05a71446-caea-40a0-a8b3-ce0b7c599aec req-8368bed8-004b-4a87-9305-0fb742d6fb78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a66de7de-7505-4ee5-bf1f-ce3608663e6f", "tag": "32407fa9-c995-4bfe-b8d6-9beb17542453"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:56:27.283409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-05a71446-caea-40a0-a8b3-ce0b7c599aec req-8368bed8-004b-4a87-9305-0fb742d6fb78 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:27.283852 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-05a71446-caea-40a0-a8b3-ce0b7c599aec req-8368bed8-004b-4a87-9305-0fb742d6fb78 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:27.295177 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-05a71446-caea-40a0-a8b3-ce0b7c599aec req-8368bed8-004b-4a87-9305-0fb742d6fb78 service nova] Creating event network-changed:32407fa9-c995-4bfe-b8d6-9beb17542453 for instance a66de7de-7505-4ee5-bf1f-ce3608663e6f on hv-cinder-82549 Jul 27 07:56:27.300303 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-05a71446-caea-40a0-a8b3-ce0b7c599aec req-8368bed8-004b-4a87-9305-0fb742d6fb78 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031178 Jul 27 07:56:27.300902 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 421/820] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:56:30.487337 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-8e662495-ada0-42c6-a7c9-634dbfe8eaf7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-421261463"}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:56:30.487855 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-8e662495-ada0-42c6-a7c9-634dbfe8eaf7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:30.490190 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:30.496486 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8e662495-ada0-42c6-a7c9-634dbfe8eaf7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:30.496943 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8e662495-ada0-42c6-a7c9-634dbfe8eaf7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:30.497705 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8e662495-ada0-42c6-a7c9-634dbfe8eaf7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:30.498136 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8e662495-ada0-42c6-a7c9-634dbfe8eaf7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:30.635785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.network.security_group_api [None req-8e662495-ada0-42c6-a7c9-634dbfe8eaf7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Removing security group 317f18a3-9a94-4860-a676-ab09055dcbca from port a6810efb-5496-44f0-a63c-6868e0e1ac93 Jul 27 07:56:30.996141 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-8e662495-ada0-42c6-a7c9-634dbfe8eaf7 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "POST /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332/action" status: 202 len: 0 microversion: 2.1 time: 0.513242 Jul 27 07:56:30.999950 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 400/821] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Jul 27 07:56:30 2022] POST /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 07:56:31.009975 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-26841424-01ca-40c9-8575-2a6d42278fbf req-e21bc0b4-176f-45be-9a9d-a826a6615725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe285eb7-17fb-48f0-b380-f21aeeb82332", "tag": "a6810efb-5496-44f0-a63c-6868e0e1ac93"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:56:31.024059 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-26841424-01ca-40c9-8575-2a6d42278fbf req-e21bc0b4-176f-45be-9a9d-a826a6615725 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:31.025511 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-26841424-01ca-40c9-8575-2a6d42278fbf req-e21bc0b4-176f-45be-9a9d-a826a6615725 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:31.039649 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-26841424-01ca-40c9-8575-2a6d42278fbf req-e21bc0b4-176f-45be-9a9d-a826a6615725 service nova] Creating event network-changed:a6810efb-5496-44f0-a63c-6868e0e1ac93 for instance fe285eb7-17fb-48f0-b380-f21aeeb82332 on hv-cinder-82549 Jul 27 07:56:31.045150 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-26841424-01ca-40c9-8575-2a6d42278fbf req-e21bc0b4-176f-45be-9a9d-a826a6615725 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042070 Jul 27 07:56:31.046514 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 422/822] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:56:32.410072 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2052917d-55c0-462e-aa64-45530c993264 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:32.410667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2052917d-55c0-462e-aa64-45530c993264 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:32.417444 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2052917d-55c0-462e-aa64-45530c993264 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:32.417893 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2052917d-55c0-462e-aa64-45530c993264 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:32.418719 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2052917d-55c0-462e-aa64-45530c993264 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:32.423622 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2052917d-55c0-462e-aa64-45530c993264 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:32.508936 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.objects.instance [None req-2052917d-55c0-462e-aa64-45530c993264 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lazy-loading 'services' on Instance uuid fe285eb7-17fb-48f0-b380-f21aeeb82332 {{(pid=117779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:56:32.584991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2052917d-55c0-462e-aa64-45530c993264 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332/os-volume_attachments/bd702758-086f-4643-952a-c373feb55a55" status: 202 len: 0 microversion: 2.1 time: 0.179063 Jul 27 07:56:32.585611 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 401/823] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Jul 27 07:56:32 2022] DELETE /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332/os-volume_attachments/bd702758-086f-4643-952a-c373feb55a55 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 07:56:32.595896 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-88116bf4-2a1b-4a11-8f45-1e8ca6c5b320 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:32.599344 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-88116bf4-2a1b-4a11-8f45-1e8ca6c5b320 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:32.607982 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-88116bf4-2a1b-4a11-8f45-1e8ca6c5b320 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:32.608702 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-88116bf4-2a1b-4a11-8f45-1e8ca6c5b320 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:32.609495 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-88116bf4-2a1b-4a11-8f45-1e8ca6c5b320 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:32.609935 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-88116bf4-2a1b-4a11-8f45-1e8ca6c5b320 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:32.643258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-88116bf4-2a1b-4a11-8f45-1e8ca6c5b320 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052047 Jul 27 07:56:32.643830 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 423/824] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:56:32 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:56:32.991605 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-87bced41-9934-4ce2-8534-e5f9641cc265 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:32.992187 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-87bced41-9934-4ce2-8534-e5f9641cc265 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:32.998604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-87bced41-9934-4ce2-8534-e5f9641cc265 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:32.999096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-87bced41-9934-4ce2-8534-e5f9641cc265 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:32.999870 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-87bced41-9934-4ce2-8534-e5f9641cc265 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:33.000310 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-87bced41-9934-4ce2-8534-e5f9641cc265 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:33.030131 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-87bced41-9934-4ce2-8534-e5f9641cc265 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/os-volume_attachments/8401fb67-f4cf-4ac1-a6b2-b1bd57984546" status: 200 len: 194 microversion: 2.20 time: 0.042910 Jul 27 07:56:33.030975 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 402/825] 10.222.0.18 () {60 vars in 1454 bytes} [Wed Jul 27 07:56:32 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/os-volume_attachments/8401fb67-f4cf-4ac1-a6b2-b1bd57984546 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 07:56:33.061793 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-725fcf18-0be0-45e8-bdd6-72bc31e71464 req-25e108ba-6e53-429d-8e18-4bfcfcd234d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe285eb7-17fb-48f0-b380-f21aeeb82332", "tag": "a6810efb-5496-44f0-a63c-6868e0e1ac93"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:56:33.068712 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:33.075966 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-725fcf18-0be0-45e8-bdd6-72bc31e71464 req-25e108ba-6e53-429d-8e18-4bfcfcd234d5 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:33.076853 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-725fcf18-0be0-45e8-bdd6-72bc31e71464 req-25e108ba-6e53-429d-8e18-4bfcfcd234d5 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:33.093257 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-725fcf18-0be0-45e8-bdd6-72bc31e71464 req-25e108ba-6e53-429d-8e18-4bfcfcd234d5 service nova] Creating event network-changed:a6810efb-5496-44f0-a63c-6868e0e1ac93 for instance fe285eb7-17fb-48f0-b380-f21aeeb82332 on hv-cinder-82549 Jul 27 07:56:33.099198 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-725fcf18-0be0-45e8-bdd6-72bc31e71464 req-25e108ba-6e53-429d-8e18-4bfcfcd234d5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042080 Jul 27 07:56:33.100147 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 424/826] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:56:33.101695 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-14d7f7f3-3208-4129-a522-c6d629c2f905 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:33.102197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-14d7f7f3-3208-4129-a522-c6d629c2f905 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:33.108338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-14d7f7f3-3208-4129-a522-c6d629c2f905 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:33.109116 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-14d7f7f3-3208-4129-a522-c6d629c2f905 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:33.109563 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-14d7f7f3-3208-4129-a522-c6d629c2f905 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:33.109998 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-14d7f7f3-3208-4129-a522-c6d629c2f905 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:33.200643 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.objects.instance [None req-14d7f7f3-3208-4129-a522-c6d629c2f905 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lazy-loading 'services' on Instance uuid 880126db-79f5-4c11-a0b5-85a612a1662a {{(pid=117779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:56:33.267939 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:33.281992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-14d7f7f3-3208-4129-a522-c6d629c2f905 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "DELETE /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/os-volume_attachments/8401fb67-f4cf-4ac1-a6b2-b1bd57984546" status: 202 len: 0 microversion: 2.20 time: 0.184113 Jul 27 07:56:33.282372 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 403/827] 10.222.0.18 () {60 vars in 1457 bytes} [Wed Jul 27 07:56:33 2022] DELETE /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/os-volume_attachments/8401fb67-f4cf-4ac1-a6b2-b1bd57984546 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 27 07:56:33.292109 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c17e40bb-8a50-4567-9c00-6c2aed3ae759 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:33.294485 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c17e40bb-8a50-4567-9c00-6c2aed3ae759 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:33.302164 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c17e40bb-8a50-4567-9c00-6c2aed3ae759 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:33.302616 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c17e40bb-8a50-4567-9c00-6c2aed3ae759 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:33.303468 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c17e40bb-8a50-4567-9c00-6c2aed3ae759 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:33.303906 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c17e40bb-8a50-4567-9c00-6c2aed3ae759 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:33.330692 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:33.339817 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c17e40bb-8a50-4567-9c00-6c2aed3ae759 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052575 Jul 27 07:56:33.340428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 425/828] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Jul 27 07:56:33 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 07:56:33.657717 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ea7925eb-1426-49eb-9ffd-17e5019b6fd8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:33.660203 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ea7925eb-1426-49eb-9ffd-17e5019b6fd8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:33.668501 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ea7925eb-1426-49eb-9ffd-17e5019b6fd8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:33.668953 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ea7925eb-1426-49eb-9ffd-17e5019b6fd8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:33.669726 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ea7925eb-1426-49eb-9ffd-17e5019b6fd8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:33.670156 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ea7925eb-1426-49eb-9ffd-17e5019b6fd8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:33.700334 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ea7925eb-1426-49eb-9ffd-17e5019b6fd8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047887 Jul 27 07:56:33.701088 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 404/829] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:56:33 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:56:34.353231 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-199c1adf-dcc7-4e47-9516-18ebd59ca1fd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:34.355502 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-199c1adf-dcc7-4e47-9516-18ebd59ca1fd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:34.363548 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-199c1adf-dcc7-4e47-9516-18ebd59ca1fd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:34.364499 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-199c1adf-dcc7-4e47-9516-18ebd59ca1fd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:34.365305 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-199c1adf-dcc7-4e47-9516-18ebd59ca1fd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:34.365741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-199c1adf-dcc7-4e47-9516-18ebd59ca1fd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:34.396282 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-199c1adf-dcc7-4e47-9516-18ebd59ca1fd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047408 Jul 27 07:56:34.396845 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 426/830] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Jul 27 07:56:34 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 07:56:34.712693 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-00e5f867-a0fb-47bd-a9e1-976a4bcfadfb tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:34.714962 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-00e5f867-a0fb-47bd-a9e1-976a4bcfadfb tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:34.721446 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-00e5f867-a0fb-47bd-a9e1-976a4bcfadfb tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:34.721881 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-00e5f867-a0fb-47bd-a9e1-976a4bcfadfb tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:34.722939 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-00e5f867-a0fb-47bd-a9e1-976a4bcfadfb tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:34.723876 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-00e5f867-a0fb-47bd-a9e1-976a4bcfadfb tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:34.753243 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-00e5f867-a0fb-47bd-a9e1-976a4bcfadfb tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044494 Jul 27 07:56:34.753839 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 405/831] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:56:34 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 07:56:34.764112 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ac343417-4e01-4fb7-8a7d-e9e559c91083 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:34.764612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ac343417-4e01-4fb7-8a7d-e9e559c91083 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:34.770645 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ac343417-4e01-4fb7-8a7d-e9e559c91083 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:34.771215 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ac343417-4e01-4fb7-8a7d-e9e559c91083 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:34.771990 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ac343417-4e01-4fb7-8a7d-e9e559c91083 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:34.772424 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ac343417-4e01-4fb7-8a7d-e9e559c91083 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:34.850436 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-ac343417-4e01-4fb7-8a7d-e9e559c91083 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] HTTP exception thrown: Instance fe285eb7-17fb-48f0-b380-f21aeeb82332 is not attached to volume bd702758-086f-4643-952a-c373feb55a55 Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ac343417-4e01-4fb7-8a7d-e9e559c91083 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Request method failure captured: Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: DELETE /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332/os-volume_attachments/bd702758-086f-4643-952a-c373feb55a55 HTTP/1.1 Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O6JJHPl2UBRL3bzHPakn5FB4yiYcO5bxrgwtvppbbnaGNhG8wL9CyRAbEI8spopbB7PRGdwhbRb_gjKlWhpSLZpxmBkVexRuX4YSJAGR1s-uFhYyXzM-MrPf5Hjku4PynvR_Ei6rPtPWWj8NdgBveD9Vd7iHOJqIWdLSCjLiTplAfg Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 4271996d22bc4364a5554c0fbff0378b Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-TestMinimumBasicScenario-1996999329 Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 07:56:34.856134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 07:56:34.857771 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4271996d22bc4364a5554c0fbff0378b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4271996d22bc4364a5554c0fbff0378b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4271996d22bc4364a5554c0fbff0378b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4271996d22bc4364a5554c0fbff0378b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:56:34.857771 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-TestMinimumBasicScenario-1996999329 Jul 27 07:56:34.857771 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 4271996d22bc4364a5554c0fbff0378b Jul 27 07:56:34.857771 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1996999329 Jul 27 07:56:34.857771 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-TestMinimumBasicScenario-1996999329-project Jul 27 07:56:34.857771 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 07:56:34.857771 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 07:56:34.857771 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: 08692d3eaab8431f8af3da2c1e098ec3 Jul 27 07:56:34.857771 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-TestMinimumBasicScenario-1996999329-project Jul 27 07:56:34.857771 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 07:56:34.857771 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance fe285eb7-17fb-48f0-b380-f21aeeb82332 is not attached to volume bd702758-086f-4643-952a-c373feb55a55 Jul 27 07:56:34.858614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'server_id': 'fe285eb7-17fb-48f0-b380-f21aeeb82332', 'id': 'bd702758-086f-4643-952a-c373feb55a55'} Jul 27 07:56:34.858614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:56:34.858614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:56:34.858614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 27 07:56:34.858614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 27 07:56:34.858614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 07:56:34.858614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 07:56:34.858614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 27 07:56:34.858614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 27 07:56:34.858614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bd702758-086f-4643-952a-c373feb55a55. Jul 27 07:56:34.858614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:34.858614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:56:34.858614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:34.858614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:56:34.858614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:56:34.858614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:56:34.858614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:56:34.858614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:56:34.858614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:56:34.859947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:56:34.859947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 27 07:56:34.859947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 27 07:56:34.859947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe285eb7-17fb-48f0-b380-f21aeeb82332 is not attached to volume bd702758-086f-4643-952a-c373feb55a55 Jul 27 07:56:34.859947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:34.859947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:56:34.859947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:34.859947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:56:34.859947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:56:34.859947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:56:34.859947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:56:34.859947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:56:34.859947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe285eb7-17fb-48f0-b380-f21aeeb82332 is not attached to volume bd702758-086f-4643-952a-c373feb55a55 Jul 27 07:56:34.859947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:34.859947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ac343417-4e01-4fb7-8a7d-e9e559c91083 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Returning 404 to user: Instance fe285eb7-17fb-48f0-b380-f21aeeb82332 is not attached to volume bd702758-086f-4643-952a-c373feb55a55 {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:56:34.860851 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ac343417-4e01-4fb7-8a7d-e9e559c91083 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332/os-volume_attachments/bd702758-086f-4643-952a-c373feb55a55" status: 404 len: 154 microversion: 2.1 time: 0.097885 Jul 27 07:56:34.860851 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 427/832] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Jul 27 07:56:34 2022] DELETE /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332/os-volume_attachments/bd702758-086f-4643-952a-c373feb55a55 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 07:56:35.408267 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0a419e02-25ef-4687-ac87-102d9c4dfa6b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:35.410358 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0a419e02-25ef-4687-ac87-102d9c4dfa6b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:35.417066 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0a419e02-25ef-4687-ac87-102d9c4dfa6b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:35.417511 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0a419e02-25ef-4687-ac87-102d9c4dfa6b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:35.418281 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0a419e02-25ef-4687-ac87-102d9c4dfa6b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:35.418737 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0a419e02-25ef-4687-ac87-102d9c4dfa6b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:35.450396 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0a419e02-25ef-4687-ac87-102d9c4dfa6b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046145 Jul 27 07:56:35.451057 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 406/833] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Jul 27 07:56:35 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 07:56:36.002567 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f46fa247-263d-4ef2-99d0-a18af749b5d8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:36.003083 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f46fa247-263d-4ef2-99d0-a18af749b5d8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:36.009784 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f46fa247-263d-4ef2-99d0-a18af749b5d8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:36.010237 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f46fa247-263d-4ef2-99d0-a18af749b5d8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:36.011035 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f46fa247-263d-4ef2-99d0-a18af749b5d8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:36.011504 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f46fa247-263d-4ef2-99d0-a18af749b5d8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:36.037350 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f46fa247-263d-4ef2-99d0-a18af749b5d8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 07:56:36.110515 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f46fa247-263d-4ef2-99d0-a18af749b5d8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 204 len: 0 microversion: 2.1 time: 0.111649 Jul 27 07:56:36.111318 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 428/834] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 07:56:35 2022] DELETE /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 07:56:36.119404 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-aefcc08d-387f-40c3-a1fd-a79af5e192a8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:36.120015 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-aefcc08d-387f-40c3-a1fd-a79af5e192a8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:36.126526 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aefcc08d-387f-40c3-a1fd-a79af5e192a8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:36.126998 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aefcc08d-387f-40c3-a1fd-a79af5e192a8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:36.127790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aefcc08d-387f-40c3-a1fd-a79af5e192a8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:36.128225 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aefcc08d-387f-40c3-a1fd-a79af5e192a8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:36.257761 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-aefcc08d-387f-40c3-a1fd-a79af5e192a8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:36.265417 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-aefcc08d-387f-40c3-a1fd-a79af5e192a8 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1553 microversion: 2.1 time: 0.149840 Jul 27 07:56:36.265986 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 407/835] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:36 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:36.463556 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7a528bab-6ab8-41d8-812f-f0e37ab5d185 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:36.465798 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7a528bab-6ab8-41d8-812f-f0e37ab5d185 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:36.471805 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7a528bab-6ab8-41d8-812f-f0e37ab5d185 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:36.472522 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7a528bab-6ab8-41d8-812f-f0e37ab5d185 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:36.473282 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7a528bab-6ab8-41d8-812f-f0e37ab5d185 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:36.473716 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7a528bab-6ab8-41d8-812f-f0e37ab5d185 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:36.503914 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7a528bab-6ab8-41d8-812f-f0e37ab5d185 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044775 Jul 27 07:56:36.504486 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 429/836] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Jul 27 07:56:36 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:36.568226 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a8966dbc-cabc-4762-b813-edcde4dab382 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:36.568747 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a8966dbc-cabc-4762-b813-edcde4dab382 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:36.574870 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a8966dbc-cabc-4762-b813-edcde4dab382 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:36.575346 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a8966dbc-cabc-4762-b813-edcde4dab382 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:36.576107 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a8966dbc-cabc-4762-b813-edcde4dab382 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:36.576539 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a8966dbc-cabc-4762-b813-edcde4dab382 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:36.601329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a8966dbc-cabc-4762-b813-edcde4dab382 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Going to try to terminate instance {{(pid=117779) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 07:56:36.675981 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a8966dbc-cabc-4762-b813-edcde4dab382 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "DELETE /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 204 len: 0 microversion: 2.20 time: 0.112411 Jul 27 07:56:36.677076 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 408/837] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Jul 27 07:56:36 2022] DELETE /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 07:56:36.685478 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6625c12d-2e3f-4d35-875e-375c974a1167 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:36.686056 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6625c12d-2e3f-4d35-875e-375c974a1167 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:36.692718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6625c12d-2e3f-4d35-875e-375c974a1167 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:36.693146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6625c12d-2e3f-4d35-875e-375c974a1167 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:36.693907 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6625c12d-2e3f-4d35-875e-375c974a1167 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:36.694339 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6625c12d-2e3f-4d35-875e-375c974a1167 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:36.823922 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6625c12d-2e3f-4d35-875e-375c974a1167 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:36.831946 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6625c12d-2e3f-4d35-875e-375c974a1167 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:36.833445 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6625c12d-2e3f-4d35-875e-375c974a1167 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:36.834593 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6625c12d-2e3f-4d35-875e-375c974a1167 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.153059 Jul 27 07:56:36.835163 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 430/838] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:56:36 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:56:37.287708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-934fb2f4-0519-4c06-bfbb-9c7855e462a0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:37.288401 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-934fb2f4-0519-4c06-bfbb-9c7855e462a0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:37.294876 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-934fb2f4-0519-4c06-bfbb-9c7855e462a0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:37.295352 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-934fb2f4-0519-4c06-bfbb-9c7855e462a0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:37.296127 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-934fb2f4-0519-4c06-bfbb-9c7855e462a0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:37.296560 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-934fb2f4-0519-4c06-bfbb-9c7855e462a0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:37.433666 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-934fb2f4-0519-4c06-bfbb-9c7855e462a0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:37.441264 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-934fb2f4-0519-4c06-bfbb-9c7855e462a0 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1553 microversion: 2.1 time: 0.157783 Jul 27 07:56:37.441830 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 409/839] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:37 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:37.858316 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-53e894ef-6820-4a6e-a08d-3ab2a4eb248a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:37.859441 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-53e894ef-6820-4a6e-a08d-3ab2a4eb248a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:37.866759 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-53e894ef-6820-4a6e-a08d-3ab2a4eb248a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:37.867246 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-53e894ef-6820-4a6e-a08d-3ab2a4eb248a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:37.868028 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-53e894ef-6820-4a6e-a08d-3ab2a4eb248a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:37.868460 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-53e894ef-6820-4a6e-a08d-3ab2a4eb248a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:38.011039 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-53e894ef-6820-4a6e-a08d-3ab2a4eb248a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:38.019081 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-53e894ef-6820-4a6e-a08d-3ab2a4eb248a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:38.021152 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-53e894ef-6820-4a6e-a08d-3ab2a4eb248a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:38.022342 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-53e894ef-6820-4a6e-a08d-3ab2a4eb248a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.168053 Jul 27 07:56:38.022913 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 431/840] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:56:37 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:56:38.463293 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1279b7c9-68c3-48b3-b420-fbd8210783a3 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:38.463906 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1279b7c9-68c3-48b3-b420-fbd8210783a3 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:38.470354 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1279b7c9-68c3-48b3-b420-fbd8210783a3 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:38.470809 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1279b7c9-68c3-48b3-b420-fbd8210783a3 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:38.471596 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1279b7c9-68c3-48b3-b420-fbd8210783a3 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:38.472038 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1279b7c9-68c3-48b3-b420-fbd8210783a3 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:38.604771 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1279b7c9-68c3-48b3-b420-fbd8210783a3 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:38.612715 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1279b7c9-68c3-48b3-b420-fbd8210783a3 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1553 microversion: 2.1 time: 0.153305 Jul 27 07:56:38.613296 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 410/841] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:38 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:39.045769 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8910d849-3764-48cf-9513-05da60a0c7d1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:39.046449 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8910d849-3764-48cf-9513-05da60a0c7d1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:39.053761 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8910d849-3764-48cf-9513-05da60a0c7d1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:39.054209 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8910d849-3764-48cf-9513-05da60a0c7d1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:39.055008 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8910d849-3764-48cf-9513-05da60a0c7d1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:39.055451 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8910d849-3764-48cf-9513-05da60a0c7d1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:39.185338 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8910d849-3764-48cf-9513-05da60a0c7d1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:39.193241 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8910d849-3764-48cf-9513-05da60a0c7d1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:39.194753 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8910d849-3764-48cf-9513-05da60a0c7d1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:39.195931 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8910d849-3764-48cf-9513-05da60a0c7d1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.154148 Jul 27 07:56:39.196492 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 432/842] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:56:39 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:56:39.634422 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1010883f-b453-42c3-b270-b67f54fd6a7d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:39.635065 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1010883f-b453-42c3-b270-b67f54fd6a7d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:39.641539 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1010883f-b453-42c3-b270-b67f54fd6a7d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:39.641985 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1010883f-b453-42c3-b270-b67f54fd6a7d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:39.642751 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1010883f-b453-42c3-b270-b67f54fd6a7d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:39.643207 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1010883f-b453-42c3-b270-b67f54fd6a7d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:39.775565 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1010883f-b453-42c3-b270-b67f54fd6a7d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:39.783095 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1010883f-b453-42c3-b270-b67f54fd6a7d tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1553 microversion: 2.1 time: 0.152495 Jul 27 07:56:39.783868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 411/843] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:39 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:40.218852 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-860d9d28-8057-4af1-b1b2-9dab905dd4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:40.220601 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-860d9d28-8057-4af1-b1b2-9dab905dd4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:40.227389 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-860d9d28-8057-4af1-b1b2-9dab905dd4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:40.228068 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-860d9d28-8057-4af1-b1b2-9dab905dd4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:40.228844 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-860d9d28-8057-4af1-b1b2-9dab905dd4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:40.229444 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-860d9d28-8057-4af1-b1b2-9dab905dd4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:40.463276 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-860d9d28-8057-4af1-b1b2-9dab905dd4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:40.472491 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-860d9d28-8057-4af1-b1b2-9dab905dd4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:40.473918 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-860d9d28-8057-4af1-b1b2-9dab905dd4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:40.475141 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-860d9d28-8057-4af1-b1b2-9dab905dd4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1725 microversion: 2.20 time: 0.260161 Jul 27 07:56:40.475709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 433/844] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:56:40 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1725 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:56:40.805329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b85f3075-17ac-4535-9cf3-1fe040a7d7bd tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:40.805963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b85f3075-17ac-4535-9cf3-1fe040a7d7bd tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:40.812897 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b85f3075-17ac-4535-9cf3-1fe040a7d7bd tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:40.813341 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b85f3075-17ac-4535-9cf3-1fe040a7d7bd tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:40.814115 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b85f3075-17ac-4535-9cf3-1fe040a7d7bd tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:40.814546 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b85f3075-17ac-4535-9cf3-1fe040a7d7bd tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:41.173572 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b85f3075-17ac-4535-9cf3-1fe040a7d7bd tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08692d3eaab8431f8af3da2c1e098ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4271996d22bc4364a5554c0fbff0378b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:41.181126 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b85f3075-17ac-4535-9cf3-1fe040a7d7bd tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 200 len: 1553 microversion: 2.1 time: 0.380375 Jul 27 07:56:41.181730 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 412/845] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:40 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 1553 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:41.345079 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-a899e285-57fb-475d-930f-a4cbacb0bcd9 req-b4bc06d5-6d04-4a22-9d76-649dd72f4648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe285eb7-17fb-48f0-b380-f21aeeb82332", "name": "network-vif-deleted", "tag": "a6810efb-5496-44f0-a63c-6868e0e1ac93"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:56:41.356141 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-a899e285-57fb-475d-930f-a4cbacb0bcd9 req-b4bc06d5-6d04-4a22-9d76-649dd72f4648 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:41.356598 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-a899e285-57fb-475d-930f-a4cbacb0bcd9 req-b4bc06d5-6d04-4a22-9d76-649dd72f4648 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:41.370052 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-a899e285-57fb-475d-930f-a4cbacb0bcd9 req-b4bc06d5-6d04-4a22-9d76-649dd72f4648 service nova] Creating event network-vif-deleted:a6810efb-5496-44f0-a63c-6868e0e1ac93 for instance fe285eb7-17fb-48f0-b380-f21aeeb82332 on hv-cinder-82549 Jul 27 07:56:41.375380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-a899e285-57fb-475d-930f-a4cbacb0bcd9 req-b4bc06d5-6d04-4a22-9d76-649dd72f4648 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034199 Jul 27 07:56:41.375970 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 434/846] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:56:41.500773 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-73350ac5-d23b-47da-90eb-c25f0faab21a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:41.501342 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-73350ac5-d23b-47da-90eb-c25f0faab21a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:41.511283 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-73350ac5-d23b-47da-90eb-c25f0faab21a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:41.511738 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-73350ac5-d23b-47da-90eb-c25f0faab21a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:41.512641 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-73350ac5-d23b-47da-90eb-c25f0faab21a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:41.513038 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-73350ac5-d23b-47da-90eb-c25f0faab21a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:41.592068 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-73350ac5-d23b-47da-90eb-c25f0faab21a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:41.600959 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-73350ac5-d23b-47da-90eb-c25f0faab21a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:41.602924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-73350ac5-d23b-47da-90eb-c25f0faab21a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:41.604386 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-73350ac5-d23b-47da-90eb-c25f0faab21a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 200 len: 1657 microversion: 2.20 time: 0.109275 Jul 27 07:56:41.605138 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 413/847] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:56:41 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 1657 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:56:42.204296 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5481c5fc-aead-4209-835d-f926b53e09d1 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:42.205109 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5481c5fc-aead-4209-835d-f926b53e09d1 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] [instance: fe285eb7-17fb-48f0-b380-f21aeeb82332] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:42.212201 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5481c5fc-aead-4209-835d-f926b53e09d1 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:42.212591 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5481c5fc-aead-4209-835d-f926b53e09d1 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:42.213368 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5481c5fc-aead-4209-835d-f926b53e09d1 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:42.213819 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5481c5fc-aead-4209-835d-f926b53e09d1 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:42.227482 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-5481c5fc-aead-4209-835d-f926b53e09d1 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] HTTP exception thrown: Instance fe285eb7-17fb-48f0-b380-f21aeeb82332 could not be found. Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5481c5fc-aead-4209-835d-f926b53e09d1 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Request method failure captured: Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 HTTP/1.1 Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O6JJHPl2UBRL3bzHPakn5FB4yiYcO5bxrgwtvppbbnaGNhG8wL9CyRAbEI8spopbB7PRGdwhbRb_gjKlWhpSLZpxmBkVexRuX4YSJAGR1s-uFhYyXzM-MrPf5Hjku4PynvR_Ei6rPtPWWj8NdgBveD9Vd7iHOJqIWdLSCjLiTplAfg Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 4271996d22bc4364a5554c0fbff0378b Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-TestMinimumBasicScenario-1996999329 Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 07:56:42.229138 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 07:56:42.230823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4271996d22bc4364a5554c0fbff0378b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4271996d22bc4364a5554c0fbff0378b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4271996d22bc4364a5554c0fbff0378b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4271996d22bc4364a5554c0fbff0378b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:56:42.230823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-TestMinimumBasicScenario-1996999329 Jul 27 07:56:42.230823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 4271996d22bc4364a5554c0fbff0378b Jul 27 07:56:42.230823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1996999329 Jul 27 07:56:42.230823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-TestMinimumBasicScenario-1996999329-project Jul 27 07:56:42.230823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 07:56:42.230823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 07:56:42.230823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: 08692d3eaab8431f8af3da2c1e098ec3 Jul 27 07:56:42.230823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-TestMinimumBasicScenario-1996999329-project Jul 27 07:56:42.230823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 07:56:42.230823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance fe285eb7-17fb-48f0-b380-f21aeeb82332 could not be found. Jul 27 07:56:42.230823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': 'fe285eb7-17fb-48f0-b380-f21aeeb82332'} Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe285eb7-17fb-48f0-b380-f21aeeb82332 could not be found. Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:56:42.231612 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:56:42.232843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:56:42.232843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 07:56:42.232843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 07:56:42.232843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 07:56:42.232843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 07:56:42.232843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 07:56:42.232843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:56:42.232843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe285eb7-17fb-48f0-b380-f21aeeb82332 could not be found. Jul 27 07:56:42.232843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:42.232843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:56:42.232843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:42.232843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:56:42.232843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:56:42.232843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:56:42.232843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:56:42.232843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:56:42.232843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe285eb7-17fb-48f0-b380-f21aeeb82332 could not be found. Jul 27 07:56:42.232843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:42.234676 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5481c5fc-aead-4209-835d-f926b53e09d1 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Returning 404 to user: Instance fe285eb7-17fb-48f0-b380-f21aeeb82332 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:56:42.234676 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5481c5fc-aead-4209-835d-f926b53e09d1 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332" status: 404 len: 111 microversion: 2.1 time: 0.030469 Jul 27 07:56:42.234676 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 435/848] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:42 2022] GET /compute/v2.1/servers/fe285eb7-17fb-48f0-b380-f21aeeb82332 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 07:56:42.240088 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9d0741e9-c68d-4c33-9e4e-b54ec34d3dd9 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] Calling method '.version_select at 0x7f19fe30d940>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:42.260354 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9d0741e9-c68d-4c33-9e4e-b54ec34d3dd9 tempest-TestMinimumBasicScenario-1996999329 tempest-TestMinimumBasicScenario-1996999329-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2001526534" status: 202 len: 0 microversion: 2.1 time: 0.024104 Jul 27 07:56:42.261155 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 414/849] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Jul 27 07:56:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2001526534 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 07:56:42.628042 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-34a6d49e-7a18-4d9d-831a-d40cd7913f53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:42.628838 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-34a6d49e-7a18-4d9d-831a-d40cd7913f53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:42.636220 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-34a6d49e-7a18-4d9d-831a-d40cd7913f53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:42.636767 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-34a6d49e-7a18-4d9d-831a-d40cd7913f53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:42.637516 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-34a6d49e-7a18-4d9d-831a-d40cd7913f53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:42.638120 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-34a6d49e-7a18-4d9d-831a-d40cd7913f53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:42.654281 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-34a6d49e-7a18-4d9d-831a-d40cd7913f53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] HTTP exception thrown: Instance 880126db-79f5-4c11-a0b5-85a612a1662a could not be found. Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-34a6d49e-7a18-4d9d-831a-d40cd7913f53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Request method failure captured: Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a HTTP/1.1 Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O4bp8Zj_qDlg-bwEJhF_0lePKtwlqhoITgzOUBl5V3Ie-Hp1jAqFLIvjXBKXQ6h780mUk5eQjA8Yb8XHGifoBm-khbEDCypukHixCybEhpPLTCRJiHKZtJHhYPENCcZ3YFRHOeieWYAgf4xDsvgBHdx7S6tiHtHm6E1NfcrbIEd33o Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 690822c00bf34b2d90eee3e2026c78fb Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2009920425 Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 07:56:42.656014 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 07:56:42.657517 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:56:42.657517 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2009920425 Jul 27 07:56:42.657517 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 690822c00bf34b2d90eee3e2026c78fb Jul 27 07:56:42.657517 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2009920425 Jul 27 07:56:42.657517 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeShelveTestJSON-2009920425-project Jul 27 07:56:42.657517 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 07:56:42.657517 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 07:56:42.657517 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: eb3d3ca2457b47a29b7c94bd8be450cd Jul 27 07:56:42.657517 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2009920425-project Jul 27 07:56:42.657517 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 07:56:42.657517 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance 880126db-79f5-4c11-a0b5-85a612a1662a could not be found. Jul 27 07:56:42.657517 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': '880126db-79f5-4c11-a0b5-85a612a1662a'} Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 880126db-79f5-4c11-a0b5-85a612a1662a could not be found. Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:56:42.658280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:56:42.659463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:56:42.659463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 07:56:42.659463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 07:56:42.659463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 07:56:42.659463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 07:56:42.659463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 07:56:42.659463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:56:42.659463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 880126db-79f5-4c11-a0b5-85a612a1662a could not be found. Jul 27 07:56:42.659463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:42.659463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:56:42.659463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:42.659463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:56:42.659463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:56:42.659463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:56:42.659463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:56:42.659463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:56:42.659463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 880126db-79f5-4c11-a0b5-85a612a1662a could not be found. Jul 27 07:56:42.659463 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:42.661183 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-34a6d49e-7a18-4d9d-831a-d40cd7913f53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Returning 404 to user: Instance 880126db-79f5-4c11-a0b5-85a612a1662a could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:56:42.661183 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-34a6d49e-7a18-4d9d-831a-d40cd7913f53 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 404 len: 111 microversion: 2.20 time: 0.034220 Jul 27 07:56:42.661183 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 436/850] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:56:42 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 07:56:42.668378 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-89ba6c9e-42ae-4f8c-9f11-9257003c66ee tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '.version_select at 0x7f19fe37f790>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:42.692393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-89ba6c9e-42ae-4f8c-9f11-9257003c66ee tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1706139137" status: 204 len: 0 microversion: 2.20 time: 0.028514 Jul 27 07:56:42.695122 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 415/851] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Jul 27 07:56:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1706139137 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 07:56:43.390865 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-17a5c673-6117-4ac9-99a8-00c465e3deea req-2ea74c53-3cdd-4881-a197-3aed237d6754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "880126db-79f5-4c11-a0b5-85a612a1662a", "name": "network-vif-deleted", "tag": "4acbfc37-e1fc-4b8f-a717-ec89154e30e4"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:56:43.405186 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-17a5c673-6117-4ac9-99a8-00c465e3deea req-2ea74c53-3cdd-4881-a197-3aed237d6754 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:43.407851 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-17a5c673-6117-4ac9-99a8-00c465e3deea req-2ea74c53-3cdd-4881-a197-3aed237d6754 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:43.408567 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-3b60f480-f4b5-4481-a780-ccf891ecf812 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Action: 'create', calling method: .version_select at 0x7f19fe31ea60>, body: {"keypair": {"name": "tempest-keypair-1777267258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDc7HLnMRBWsSI/GGeobxltqiJQAYa7alFQ95nWLOpj9v8Vki5vAfPUqW2XTiNVMjRRpgsdyl0NJRehHNf3VavRt5LTmMv82vuJn66b64RSqamMXCo3GvSepXsDsbiH7fA=="}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:56:43.424432 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-17a5c673-6117-4ac9-99a8-00c465e3deea req-2ea74c53-3cdd-4881-a197-3aed237d6754 service nova] Creating event network-vif-deleted:4acbfc37-e1fc-4b8f-a717-ec89154e30e4 for instance 880126db-79f5-4c11-a0b5-85a612a1662a on hv-cinder-82549 Jul 27 07:56:43.426533 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-3b60f480-f4b5-4481-a780-ccf891ecf812 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Getting quotas for project 690822c00bf34b2d90eee3e2026c78fb. Resources: {'key_pairs'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:56:43.431035 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-3b60f480-f4b5-4481-a780-ccf891ecf812 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Getting quotas for user eb3d3ca2457b47a29b7c94bd8be450cd and project 690822c00bf34b2d90eee3e2026c78fb. Resources: {'key_pairs'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:56:43.431816 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-17a5c673-6117-4ac9-99a8-00c465e3deea req-2ea74c53-3cdd-4881-a197-3aed237d6754 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044353 Jul 27 07:56:43.433911 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 437/852] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:56:43.456522 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-3b60f480-f4b5-4481-a780-ccf891ecf812 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051850 Jul 27 07:56:43.457122 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 416/853] 10.222.0.18 () {62 vars in 1200 bytes} [Wed Jul 27 07:56:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 27 07:56:44.919766 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1e4e8559-72ef-4c7d-b3ea-c5acf0de5ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1522275761", "imageRef": "646bfb5d-ef25-404a-a432-35d4209840fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1972cd38-3033-48aa-ada5-6e0fb660b5ac"}], "security_groups": [{"name": "tempest-securitygroup--1350393099"}], "key_name": "tempest-keypair-1777267258", "user_data": "}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:56:45.135598 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.network.neutron [None req-1e4e8559-72ef-4c7d-b3ea-c5acf0de5ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] validate_networks() for [('1972cd38-3033-48aa-ada5-6e0fb660b5ac', None, None, None, None, None)] {{(pid=117780) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:56:45.914872 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-1e4e8559-72ef-4c7d-b3ea-c5acf0de5ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Flavor limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:56:45.915414 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-1e4e8559-72ef-4c7d-b3ea-c5acf0de5ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Image limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:56:45.915915 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-1e4e8559-72ef-4c7d-b3ea-c5acf0de5ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Flavor pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:56:45.916376 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-1e4e8559-72ef-4c7d-b3ea-c5acf0de5ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Image pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:56:45.917084 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-1e4e8559-72ef-4c7d-b3ea-c5acf0de5ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:56:45.926853 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e4e8559-72ef-4c7d-b3ea-c5acf0de5ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:45.927534 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e4e8559-72ef-4c7d-b3ea-c5acf0de5ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:45.928213 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e4e8559-72ef-4c7d-b3ea-c5acf0de5ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:45.928833 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e4e8559-72ef-4c7d-b3ea-c5acf0de5ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:45.951708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-1e4e8559-72ef-4c7d-b3ea-c5acf0de5ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Getting quotas for project 690822c00bf34b2d90eee3e2026c78fb. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:56:45.955798 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-559a94c4-0cd2-470f-9db2-154348a48a4d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:45.956356 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-1e4e8559-72ef-4c7d-b3ea-c5acf0de5ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Getting quotas for user eb3d3ca2457b47a29b7c94bd8be450cd and project 690822c00bf34b2d90eee3e2026c78fb. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:56:45.960647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-559a94c4-0cd2-470f-9db2-154348a48a4d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:45.969573 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-559a94c4-0cd2-470f-9db2-154348a48a4d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:45.970490 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-559a94c4-0cd2-470f-9db2-154348a48a4d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:45.971053 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1e4e8559-72ef-4c7d-b3ea-c5acf0de5ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Going to run 1 instances... {{(pid=117780) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:56:45.971728 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-559a94c4-0cd2-470f-9db2-154348a48a4d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:45.972408 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-559a94c4-0cd2-470f-9db2-154348a48a4d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:45.973922 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1e4e8559-72ef-4c7d-b3ea-c5acf0de5ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='646bfb5d-ef25-404a-a432-35d4209840fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:56:46.013336 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-559a94c4-0cd2-470f-9db2-154348a48a4d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Going to try to terminate instance {{(pid=117779) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 07:56:46.045939 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1e4e8559-72ef-4c7d-b3ea-c5acf0de5ca1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.130908 Jul 27 07:56:46.046784 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 438/854] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Jul 27 07:56:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 27 07:56:46.061658 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f41a0ce2-0333-4644-a623-960a3239f212 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:46.068757 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f41a0ce2-0333-4644-a623-960a3239f212 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:46.122393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-559a94c4-0cd2-470f-9db2-154348a48a4d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 204 len: 0 microversion: 2.1 time: 0.170274 Jul 27 07:56:46.123458 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 417/855] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 07:56:45 2022] DELETE /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 07:56:46.133413 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d9e21f07-8bdc-4b46-a54d-da7226c07557 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:46.134216 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d9e21f07-8bdc-4b46-a54d-da7226c07557 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:46.141345 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d9e21f07-8bdc-4b46-a54d-da7226c07557 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:46.142703 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d9e21f07-8bdc-4b46-a54d-da7226c07557 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:46.143761 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d9e21f07-8bdc-4b46-a54d-da7226c07557 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:46.144432 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d9e21f07-8bdc-4b46-a54d-da7226c07557 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:46.157943 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f41a0ce2-0333-4644-a623-960a3239f212 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:46.169237 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f41a0ce2-0333-4644-a623-960a3239f212 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:46.171772 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f41a0ce2-0333-4644-a623-960a3239f212 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:46.173207 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f41a0ce2-0333-4644-a623-960a3239f212 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1282 microversion: 2.20 time: 0.118599 Jul 27 07:56:46.174434 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 439/856] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:56:46 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1282 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:56:46.327895 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d9e21f07-8bdc-4b46-a54d-da7226c07557 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:46.337126 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d9e21f07-8bdc-4b46-a54d-da7226c07557 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1576 microversion: 2.1 time: 0.209527 Jul 27 07:56:46.337926 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 418/857] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:46 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:47.196750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-14afa129-1744-4c14-803f-333b54296b7d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:47.197345 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-14afa129-1744-4c14-803f-333b54296b7d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:47.204095 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14afa129-1744-4c14-803f-333b54296b7d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:47.204542 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14afa129-1744-4c14-803f-333b54296b7d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:47.205305 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14afa129-1744-4c14-803f-333b54296b7d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:47.205738 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14afa129-1744-4c14-803f-333b54296b7d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:47.268847 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-14afa129-1744-4c14-803f-333b54296b7d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:47.279654 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-14afa129-1744-4c14-803f-333b54296b7d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:47.281592 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-14afa129-1744-4c14-803f-333b54296b7d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:47.282476 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-14afa129-1744-4c14-803f-333b54296b7d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1286 microversion: 2.20 time: 0.089749 Jul 27 07:56:47.283067 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 440/858] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:56:47 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:56:47.360270 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1a2a81d7-553c-4739-b54a-016d9df0f709 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:47.362584 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1a2a81d7-553c-4739-b54a-016d9df0f709 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:47.369801 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1a2a81d7-553c-4739-b54a-016d9df0f709 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:47.370259 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1a2a81d7-553c-4739-b54a-016d9df0f709 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:47.371042 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1a2a81d7-553c-4739-b54a-016d9df0f709 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:47.371478 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1a2a81d7-553c-4739-b54a-016d9df0f709 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:47.611139 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1a2a81d7-553c-4739-b54a-016d9df0f709 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:47.622295 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1a2a81d7-553c-4739-b54a-016d9df0f709 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1576 microversion: 2.1 time: 0.266483 Jul 27 07:56:47.622871 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 419/859] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:47 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1576 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:48.308503 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c650f9b8-9d28-4bd4-a7be-0eaf7038d537 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:48.309111 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c650f9b8-9d28-4bd4-a7be-0eaf7038d537 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:48.317042 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c650f9b8-9d28-4bd4-a7be-0eaf7038d537 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:48.317758 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c650f9b8-9d28-4bd4-a7be-0eaf7038d537 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:48.318728 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c650f9b8-9d28-4bd4-a7be-0eaf7038d537 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:48.319187 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c650f9b8-9d28-4bd4-a7be-0eaf7038d537 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:48.385027 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c650f9b8-9d28-4bd4-a7be-0eaf7038d537 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:48.393300 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c650f9b8-9d28-4bd4-a7be-0eaf7038d537 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:48.395429 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c650f9b8-9d28-4bd4-a7be-0eaf7038d537 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:48.397092 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c650f9b8-9d28-4bd4-a7be-0eaf7038d537 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1334 microversion: 2.20 time: 0.094819 Jul 27 07:56:48.397656 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 441/860] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:56:48 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1334 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:56:48.643894 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a7676481-20fa-4e86-82bb-f694284cc033 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:48.644721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a7676481-20fa-4e86-82bb-f694284cc033 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:48.651608 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a7676481-20fa-4e86-82bb-f694284cc033 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:48.652257 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a7676481-20fa-4e86-82bb-f694284cc033 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:48.653100 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a7676481-20fa-4e86-82bb-f694284cc033 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:48.653533 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a7676481-20fa-4e86-82bb-f694284cc033 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:48.656983 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:49.025225 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a7676481-20fa-4e86-82bb-f694284cc033 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:49.039715 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a7676481-20fa-4e86-82bb-f694284cc033 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1576 microversion: 2.1 time: 0.399528 Jul 27 07:56:49.041060 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 420/861] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:48 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1576 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:49.420387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3697d25b-a99c-4f72-926a-0aded728c85a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:49.421593 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3697d25b-a99c-4f72-926a-0aded728c85a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:49.440422 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3697d25b-a99c-4f72-926a-0aded728c85a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:49.441019 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3697d25b-a99c-4f72-926a-0aded728c85a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:49.442145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3697d25b-a99c-4f72-926a-0aded728c85a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:49.442969 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3697d25b-a99c-4f72-926a-0aded728c85a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:49.561204 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3697d25b-a99c-4f72-926a-0aded728c85a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:49.571099 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3697d25b-a99c-4f72-926a-0aded728c85a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:49.572664 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3697d25b-a99c-4f72-926a-0aded728c85a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:49.573788 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3697d25b-a99c-4f72-926a-0aded728c85a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1340 microversion: 2.20 time: 0.158195 Jul 27 07:56:49.574565 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 442/862] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:56:49 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1340 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:56:50.067033 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c8e88679-3c76-4c02-8ac1-b3b98184836b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:50.067033 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c8e88679-3c76-4c02-8ac1-b3b98184836b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:50.075431 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c8e88679-3c76-4c02-8ac1-b3b98184836b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:50.076222 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c8e88679-3c76-4c02-8ac1-b3b98184836b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:50.077954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c8e88679-3c76-4c02-8ac1-b3b98184836b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:50.078536 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c8e88679-3c76-4c02-8ac1-b3b98184836b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:50.196183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c8e88679-3c76-4c02-8ac1-b3b98184836b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:50.209174 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c8e88679-3c76-4c02-8ac1-b3b98184836b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1509 microversion: 2.1 time: 0.147597 Jul 27 07:56:50.210717 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 421/863] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:50 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:50.393417 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-5a45ec6b-e8ce-41f5-abaf-409c3ace9c3f req-3d457838-6cd3-46f9-af9b-beb706d780e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d599a647-2c57-4095-8875-7eb9ac54150f", "name": "network-vif-deleted", "tag": "0e2e33bc-ba25-4cd3-9bd5-b56a3d33a66e"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:56:50.445842 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-5a45ec6b-e8ce-41f5-abaf-409c3ace9c3f req-3d457838-6cd3-46f9-af9b-beb706d780e5 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:50.446924 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-5a45ec6b-e8ce-41f5-abaf-409c3ace9c3f req-3d457838-6cd3-46f9-af9b-beb706d780e5 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:50.486283 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-5a45ec6b-e8ce-41f5-abaf-409c3ace9c3f req-3d457838-6cd3-46f9-af9b-beb706d780e5 service nova] Creating event network-vif-deleted:0e2e33bc-ba25-4cd3-9bd5-b56a3d33a66e for instance d599a647-2c57-4095-8875-7eb9ac54150f on hv-cinder-82549 Jul 27 07:56:50.510312 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-5a45ec6b-e8ce-41f5-abaf-409c3ace9c3f req-3d457838-6cd3-46f9-af9b-beb706d780e5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121477 Jul 27 07:56:50.518700 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 443/864] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:56:50.598310 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c84b4b17-2a44-49d1-a0b6-1cd6cb2470ea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:50.599162 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c84b4b17-2a44-49d1-a0b6-1cd6cb2470ea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:50.613349 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c84b4b17-2a44-49d1-a0b6-1cd6cb2470ea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:50.614103 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c84b4b17-2a44-49d1-a0b6-1cd6cb2470ea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:50.615897 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c84b4b17-2a44-49d1-a0b6-1cd6cb2470ea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:50.617893 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c84b4b17-2a44-49d1-a0b6-1cd6cb2470ea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:50.975406 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c84b4b17-2a44-49d1-a0b6-1cd6cb2470ea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:50.986753 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c84b4b17-2a44-49d1-a0b6-1cd6cb2470ea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:50.990115 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c84b4b17-2a44-49d1-a0b6-1cd6cb2470ea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:50.991278 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c84b4b17-2a44-49d1-a0b6-1cd6cb2470ea tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1408 microversion: 2.20 time: 0.397533 Jul 27 07:56:50.997264 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 422/865] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:56:50 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1408 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:56:51.233451 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-484eb74d-750c-4ee0-9699-4640f7fd8153 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:51.240223 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-484eb74d-750c-4ee0-9699-4640f7fd8153 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:51.250345 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-484eb74d-750c-4ee0-9699-4640f7fd8153 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:51.251190 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-484eb74d-750c-4ee0-9699-4640f7fd8153 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:51.252311 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-484eb74d-750c-4ee0-9699-4640f7fd8153 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:51.252994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-484eb74d-750c-4ee0-9699-4640f7fd8153 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:51.289738 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-484eb74d-750c-4ee0-9699-4640f7fd8153 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:51.290657 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-484eb74d-750c-4ee0-9699-4640f7fd8153 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:51.291436 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-484eb74d-750c-4ee0-9699-4640f7fd8153 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lazy-loading 'fault' on Instance uuid d599a647-2c57-4095-8875-7eb9ac54150f {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:56:51.365511 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-484eb74d-750c-4ee0-9699-4640f7fd8153 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:51.375458 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-484eb74d-750c-4ee0-9699-4640f7fd8153 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 200 len: 1230 microversion: 2.1 time: 0.145973 Jul 27 07:56:51.381947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 444/866] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:51 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 1230 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:52.017786 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ee814e7e-8383-44d8-9f95-03498ea7bc32 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:52.018395 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ee814e7e-8383-44d8-9f95-03498ea7bc32 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:52.026375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ee814e7e-8383-44d8-9f95-03498ea7bc32 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:52.027195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ee814e7e-8383-44d8-9f95-03498ea7bc32 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:52.028140 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ee814e7e-8383-44d8-9f95-03498ea7bc32 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:52.028725 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ee814e7e-8383-44d8-9f95-03498ea7bc32 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:52.281998 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ee814e7e-8383-44d8-9f95-03498ea7bc32 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:52.291246 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ee814e7e-8383-44d8-9f95-03498ea7bc32 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:52.292975 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ee814e7e-8383-44d8-9f95-03498ea7bc32 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:52.295038 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ee814e7e-8383-44d8-9f95-03498ea7bc32 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1408 microversion: 2.20 time: 0.280821 Jul 27 07:56:52.295622 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 423/867] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:56:52 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1408 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:56:52.404049 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-489447f6-d7eb-48e8-9d63-9705216770f0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:52.404928 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-489447f6-d7eb-48e8-9d63-9705216770f0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:52.412700 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-489447f6-d7eb-48e8-9d63-9705216770f0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:52.413160 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-489447f6-d7eb-48e8-9d63-9705216770f0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:52.414095 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-489447f6-d7eb-48e8-9d63-9705216770f0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:52.414541 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-489447f6-d7eb-48e8-9d63-9705216770f0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:52.435122 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-489447f6-d7eb-48e8-9d63-9705216770f0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] HTTP exception thrown: Instance d599a647-2c57-4095-8875-7eb9ac54150f could not be found. Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-489447f6-d7eb-48e8-9d63-9705216770f0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Request method failure captured: Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f HTTP/1.1 Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O7KpAQ6XfKzTXe-iBA5-JLCsVSF4Y96Cj8-R4OU_NYeCFoCW9MK56UYNRfQ5O0gdUm0FlGdL4FELMiPSW2DsGPZlC8X3bqonPMfDHw7UeH3q39pasJF713Q1KOzLxAbMQUZdaylQTEWzwJeOqeTNKNqEoWSoqd4G0YdtrfpiEPpi84 Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 479f452a345b4c219d32d2ad78183af6 Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-TestVolumeBootPattern-144646060 Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 07:56:52.438358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 07:56:52.440792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/479f452a345b4c219d32d2ad78183af6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_479f452a345b4c219d32d2ad78183af6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/479f452a345b4c219d32d2ad78183af6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/479f452a345b4c219d32d2ad78183af6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:56:52.440792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-TestVolumeBootPattern-144646060 Jul 27 07:56:52.440792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 479f452a345b4c219d32d2ad78183af6 Jul 27 07:56:52.440792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-TestVolumeBootPattern-144646060 Jul 27 07:56:52.440792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-TestVolumeBootPattern-144646060-project Jul 27 07:56:52.440792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 07:56:52.440792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 07:56:52.440792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: 5efb3ea424f8450c883d4757545af18d Jul 27 07:56:52.440792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-TestVolumeBootPattern-144646060-project Jul 27 07:56:52.440792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 07:56:52.440792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance d599a647-2c57-4095-8875-7eb9ac54150f could not be found. Jul 27 07:56:52.440792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': 'd599a647-2c57-4095-8875-7eb9ac54150f'} Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d599a647-2c57-4095-8875-7eb9ac54150f could not be found. Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:56:52.442346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:56:52.445474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:56:52.445474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 07:56:52.445474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 07:56:52.445474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 07:56:52.445474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 07:56:52.445474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 07:56:52.445474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:56:52.445474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d599a647-2c57-4095-8875-7eb9ac54150f could not be found. Jul 27 07:56:52.445474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:52.445474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:56:52.445474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:52.445474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:56:52.445474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:56:52.445474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:56:52.445474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:56:52.445474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:56:52.445474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d599a647-2c57-4095-8875-7eb9ac54150f could not be found. Jul 27 07:56:52.445474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:56:52.447787 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-489447f6-d7eb-48e8-9d63-9705216770f0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Returning 404 to user: Instance d599a647-2c57-4095-8875-7eb9ac54150f could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:56:52.447787 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-489447f6-d7eb-48e8-9d63-9705216770f0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 404 len: 111 microversion: 2.1 time: 0.038266 Jul 27 07:56:52.447787 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 445/868] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:52 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 07:56:52.561595 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-5c670ad4-0296-4eb2-8a6e-aaab2a87104f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-335203025", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-506878589", "security_groups": [{"name": "tempest-secgroup-smoke-844798545"}], "block_device_mapping_v2": [{"uuid": "8b7c7b08-2118-43be-8b25-9ffe013d6094", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6f4c8516-f20c-40ca-8fd7-7c9a143ac3f6"}]}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:56:52.602998 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-44be188e-498b-45c6-9d47-d85853fff09a req-4c768e6a-1949-484a-99d8-9eb609001034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2", "tag": "19f48487-6051-4c27-9a27-015b3b0d174a"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:56:52.615593 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-44be188e-498b-45c6-9d47-d85853fff09a req-4c768e6a-1949-484a-99d8-9eb609001034 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:52.616175 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-44be188e-498b-45c6-9d47-d85853fff09a req-4c768e6a-1949-484a-99d8-9eb609001034 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:52.620371 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:52.633077 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-44be188e-498b-45c6-9d47-d85853fff09a req-4c768e6a-1949-484a-99d8-9eb609001034 service nova] Creating event network-changed:19f48487-6051-4c27-9a27-015b3b0d174a for instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 on hv-cinder-82549 Jul 27 07:56:52.638584 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-44be188e-498b-45c6-9d47-d85853fff09a req-4c768e6a-1949-484a-99d8-9eb609001034 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039246 Jul 27 07:56:52.639339 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 446/869] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:56:52.697948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.network.neutron [None req-5c670ad4-0296-4eb2-8a6e-aaab2a87104f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] validate_networks() for [('6f4c8516-f20c-40ca-8fd7-7c9a143ac3f6', None, None, None, None, None)] {{(pid=117779) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:56:53.081291 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-5c670ad4-0296-4eb2-8a6e-aaab2a87104f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Flavor limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:56:53.081861 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-5c670ad4-0296-4eb2-8a6e-aaab2a87104f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Image limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:56:53.082174 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-5c670ad4-0296-4eb2-8a6e-aaab2a87104f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Flavor pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:56:53.082583 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-5c670ad4-0296-4eb2-8a6e-aaab2a87104f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Image pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:56:53.083022 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-5c670ad4-0296-4eb2-8a6e-aaab2a87104f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:56:53.092189 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5c670ad4-0296-4eb2-8a6e-aaab2a87104f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:53.092639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5c670ad4-0296-4eb2-8a6e-aaab2a87104f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:53.093435 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5c670ad4-0296-4eb2-8a6e-aaab2a87104f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:53.093868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5c670ad4-0296-4eb2-8a6e-aaab2a87104f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:53.110545 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-5c670ad4-0296-4eb2-8a6e-aaab2a87104f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Getting quotas for project 479f452a345b4c219d32d2ad78183af6. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:56:53.115040 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-5c670ad4-0296-4eb2-8a6e-aaab2a87104f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Getting quotas for user 5efb3ea424f8450c883d4757545af18d and project 479f452a345b4c219d32d2ad78183af6. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:56:53.171183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-5c670ad4-0296-4eb2-8a6e-aaab2a87104f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Going to run 1 instances... {{(pid=117779) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:56:53.173253 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-5c670ad4-0296-4eb2-8a6e-aaab2a87104f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b7c7b08-2118-43be-8b25-9ffe013d6094',volume_size=None,volume_type=None)] {{(pid=117779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:56:53.303808 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-5c670ad4-0296-4eb2-8a6e-aaab2a87104f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.746114 Jul 27 07:56:53.304457 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 424/870] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 07:56:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 07:56:53.317182 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-240fa016-14c8-4ea8-b8c3-db91a4190d7f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:53.317618 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1cbbeafe-9fc9-401f-87cc-f6b4374136c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:53.318092 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-240fa016-14c8-4ea8-b8c3-db91a4190d7f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:53.318265 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1cbbeafe-9fc9-401f-87cc-f6b4374136c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:53.325332 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1cbbeafe-9fc9-401f-87cc-f6b4374136c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:53.325788 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1cbbeafe-9fc9-401f-87cc-f6b4374136c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:53.326634 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1cbbeafe-9fc9-401f-87cc-f6b4374136c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:53.327628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1cbbeafe-9fc9-401f-87cc-f6b4374136c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:53.386424 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-240fa016-14c8-4ea8-b8c3-db91a4190d7f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:53.393935 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-240fa016-14c8-4ea8-b8c3-db91a4190d7f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1093 microversion: 2.1 time: 0.082199 Jul 27 07:56:53.394548 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 447/871] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:53 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1093 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:53.465118 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1cbbeafe-9fc9-401f-87cc-f6b4374136c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:53.474915 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1cbbeafe-9fc9-401f-87cc-f6b4374136c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:53.476480 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1cbbeafe-9fc9-401f-87cc-f6b4374136c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:53.477603 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1cbbeafe-9fc9-401f-87cc-f6b4374136c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1408 microversion: 2.20 time: 0.164165 Jul 27 07:56:53.478163 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 425/872] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:56:53 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:56:54.415291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-517aa141-005f-49ae-97d4-695a2b82cde1 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:54.415922 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-517aa141-005f-49ae-97d4-695a2b82cde1 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:54.423017 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-517aa141-005f-49ae-97d4-695a2b82cde1 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:54.423468 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-517aa141-005f-49ae-97d4-695a2b82cde1 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:54.424257 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-517aa141-005f-49ae-97d4-695a2b82cde1 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:54.424697 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-517aa141-005f-49ae-97d4-695a2b82cde1 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:54.485945 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-517aa141-005f-49ae-97d4-695a2b82cde1 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:54.493291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-517aa141-005f-49ae-97d4-695a2b82cde1 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1143 microversion: 2.1 time: 0.081925 Jul 27 07:56:54.493845 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 448/873] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:54 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:54.500755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1167bd90-b3e6-4165-a104-28444567a48e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:54.501341 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1167bd90-b3e6-4165-a104-28444567a48e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:54.507954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1167bd90-b3e6-4165-a104-28444567a48e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:54.508398 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1167bd90-b3e6-4165-a104-28444567a48e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:54.509156 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1167bd90-b3e6-4165-a104-28444567a48e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:54.509588 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1167bd90-b3e6-4165-a104-28444567a48e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:54.646961 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1167bd90-b3e6-4165-a104-28444567a48e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:54.654984 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1167bd90-b3e6-4165-a104-28444567a48e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:54.656531 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1167bd90-b3e6-4165-a104-28444567a48e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:54.657605 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1167bd90-b3e6-4165-a104-28444567a48e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1408 microversion: 2.20 time: 0.160785 Jul 27 07:56:54.658159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 426/874] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:56:54 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:56:55.514865 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fd5825be-1a6e-4785-8632-c2189aea8002 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:55.515844 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fd5825be-1a6e-4785-8632-c2189aea8002 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:55.522759 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd5825be-1a6e-4785-8632-c2189aea8002 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:55.523378 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd5825be-1a6e-4785-8632-c2189aea8002 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:55.524281 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd5825be-1a6e-4785-8632-c2189aea8002 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:55.524749 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd5825be-1a6e-4785-8632-c2189aea8002 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:55.592280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fd5825be-1a6e-4785-8632-c2189aea8002 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:55.601962 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fd5825be-1a6e-4785-8632-c2189aea8002 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1199 microversion: 2.1 time: 0.091259 Jul 27 07:56:55.602789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 449/875] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:55 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1199 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:56:55.681571 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-acad8ef5-357b-4ac7-a21b-83a518a2db3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:55.682291 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-acad8ef5-357b-4ac7-a21b-83a518a2db3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:55.689258 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-acad8ef5-357b-4ac7-a21b-83a518a2db3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:55.689790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-acad8ef5-357b-4ac7-a21b-83a518a2db3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:55.690634 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-acad8ef5-357b-4ac7-a21b-83a518a2db3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:55.691158 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-acad8ef5-357b-4ac7-a21b-83a518a2db3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:56.117948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-acad8ef5-357b-4ac7-a21b-83a518a2db3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:56.126040 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-acad8ef5-357b-4ac7-a21b-83a518a2db3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:56.127600 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-acad8ef5-357b-4ac7-a21b-83a518a2db3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:56.128703 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-acad8ef5-357b-4ac7-a21b-83a518a2db3e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1408 microversion: 2.20 time: 0.452478 Jul 27 07:56:56.129274 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 427/876] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:56:55 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1408 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:56:56.624525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4e2df0de-43f7-45ff-b739-25250aadeb24 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:56.625965 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4e2df0de-43f7-45ff-b739-25250aadeb24 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:56.629228 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:56.635781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4e2df0de-43f7-45ff-b739-25250aadeb24 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:56.636236 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4e2df0de-43f7-45ff-b739-25250aadeb24 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:56.637029 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4e2df0de-43f7-45ff-b739-25250aadeb24 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:56.637657 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4e2df0de-43f7-45ff-b739-25250aadeb24 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:56.789787 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4e2df0de-43f7-45ff-b739-25250aadeb24 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:56.797922 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4e2df0de-43f7-45ff-b739-25250aadeb24 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1264 microversion: 2.1 time: 0.177258 Jul 27 07:56:56.798515 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 450/877] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:56 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:56:57.152005 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-56436f6b-7787-46a5-9ec8-ff72771132cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:57.152614 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-56436f6b-7787-46a5-9ec8-ff72771132cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:57.159129 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-56436f6b-7787-46a5-9ec8-ff72771132cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:57.159576 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-56436f6b-7787-46a5-9ec8-ff72771132cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:57.160344 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-56436f6b-7787-46a5-9ec8-ff72771132cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:57.160782 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-56436f6b-7787-46a5-9ec8-ff72771132cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:57.366308 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-56436f6b-7787-46a5-9ec8-ff72771132cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:57.374289 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-56436f6b-7787-46a5-9ec8-ff72771132cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:57.376114 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-56436f6b-7787-46a5-9ec8-ff72771132cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:57.377717 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-56436f6b-7787-46a5-9ec8-ff72771132cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1408 microversion: 2.20 time: 0.229609 Jul 27 07:56:57.378735 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 428/878] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:56:57 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:56:57.504270 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-4bd3dbdc-c564-4e37-b8df-7440ca3dddba req-3db66a3e-7ab6-48b9-a043-5103f28e95fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420dfa7a-bd3b-4449-9928-620bf72f2725", "tag": "ad07f686-5948-477d-8818-90133cb4c39f"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:56:57.515285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-4bd3dbdc-c564-4e37-b8df-7440ca3dddba req-3db66a3e-7ab6-48b9-a043-5103f28e95fc service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:57.515728 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-4bd3dbdc-c564-4e37-b8df-7440ca3dddba req-3db66a3e-7ab6-48b9-a043-5103f28e95fc service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:57.530538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-4bd3dbdc-c564-4e37-b8df-7440ca3dddba req-3db66a3e-7ab6-48b9-a043-5103f28e95fc service nova] Creating event network-changed:ad07f686-5948-477d-8818-90133cb4c39f for instance 420dfa7a-bd3b-4449-9928-620bf72f2725 on hv-cinder-82549 Jul 27 07:56:57.536039 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-4bd3dbdc-c564-4e37-b8df-7440ca3dddba req-3db66a3e-7ab6-48b9-a043-5103f28e95fc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048184 Jul 27 07:56:57.536813 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 451/879] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:56:57.820164 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-86f006f9-36f9-4124-b65c-fa9a581058a4 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:57.820844 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-86f006f9-36f9-4124-b65c-fa9a581058a4 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:57.823050 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:56:57.829896 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-86f006f9-36f9-4124-b65c-fa9a581058a4 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:57.830337 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-86f006f9-36f9-4124-b65c-fa9a581058a4 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:57.831604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-86f006f9-36f9-4124-b65c-fa9a581058a4 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:57.832069 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-86f006f9-36f9-4124-b65c-fa9a581058a4 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:58.026709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-872e42e3-38f2-485d-8921-f6673ae19fc0 req-3378c2b8-1cfc-4538-9904-51026d63d166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2", "name": "network-vif-plugged", "status": "completed", "tag": "19f48487-6051-4c27-9a27-015b3b0d174a"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:56:58.033802 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-86f006f9-36f9-4124-b65c-fa9a581058a4 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:58.042298 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-86f006f9-36f9-4124-b65c-fa9a581058a4 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1264 microversion: 2.1 time: 0.225974 Jul 27 07:56:58.043251 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 429/880] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:57 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:56:58.048047 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-872e42e3-38f2-485d-8921-f6673ae19fc0 req-3378c2b8-1cfc-4538-9904-51026d63d166 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:58.048608 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-872e42e3-38f2-485d-8921-f6673ae19fc0 req-3378c2b8-1cfc-4538-9904-51026d63d166 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:58.061879 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-872e42e3-38f2-485d-8921-f6673ae19fc0 req-3378c2b8-1cfc-4538-9904-51026d63d166 service nova] Creating event network-vif-plugged:19f48487-6051-4c27-9a27-015b3b0d174a for instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 on hv-cinder-82549 Jul 27 07:56:58.066646 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-872e42e3-38f2-485d-8921-f6673ae19fc0 req-3378c2b8-1cfc-4538-9904-51026d63d166 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050430 Jul 27 07:56:58.067534 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 452/881] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:56:58.401064 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9b45b5e5-1617-4fbc-ab85-3947046f7889 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:58.401706 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-9b45b5e5-1617-4fbc-ab85-3947046f7889 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:58.408159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9b45b5e5-1617-4fbc-ab85-3947046f7889 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:58.408604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9b45b5e5-1617-4fbc-ab85-3947046f7889 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:58.409361 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9b45b5e5-1617-4fbc-ab85-3947046f7889 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:58.409819 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9b45b5e5-1617-4fbc-ab85-3947046f7889 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:58.544693 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9b45b5e5-1617-4fbc-ab85-3947046f7889 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:58.554057 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9b45b5e5-1617-4fbc-ab85-3947046f7889 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:58.555797 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9b45b5e5-1617-4fbc-ab85-3947046f7889 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:58.557094 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9b45b5e5-1617-4fbc-ab85-3947046f7889 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1408 microversion: 2.20 time: 0.160065 Jul 27 07:56:58.557655 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 430/882] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:56:58 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:56:59.066258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c93c34ee-9949-4812-95e1-326f73ea549f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:59.067056 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c93c34ee-9949-4812-95e1-326f73ea549f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:59.074710 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c93c34ee-9949-4812-95e1-326f73ea549f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:59.077315 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c93c34ee-9949-4812-95e1-326f73ea549f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:59.077315 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c93c34ee-9949-4812-95e1-326f73ea549f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:59.077315 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c93c34ee-9949-4812-95e1-326f73ea549f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:59.229798 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c93c34ee-9949-4812-95e1-326f73ea549f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:59.240847 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c93c34ee-9949-4812-95e1-326f73ea549f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1264 microversion: 2.1 time: 0.179739 Jul 27 07:56:59.241688 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 453/883] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:56:59 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:56:59.335439 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-49576835-8fcc-40c0-a7c0-461efcfbc21b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:59.335939 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-49576835-8fcc-40c0-a7c0-461efcfbc21b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:59.341898 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-49576835-8fcc-40c0-a7c0-461efcfbc21b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:59.342349 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-49576835-8fcc-40c0-a7c0-461efcfbc21b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:59.343147 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-49576835-8fcc-40c0-a7c0-461efcfbc21b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:59.343587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-49576835-8fcc-40c0-a7c0-461efcfbc21b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:59.426240 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.objects.instance [None req-49576835-8fcc-40c0-a7c0-461efcfbc21b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lazy-loading 'services' on Instance uuid a94a8a11-679a-4c4c-b46b-c4a323068eb7 {{(pid=117779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:56:59.502304 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-49576835-8fcc-40c0-a7c0-461efcfbc21b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/os-volume_attachments/8ea21f82-ce86-4800-8924-54d7fb5baedd" status: 202 len: 0 microversion: 2.1 time: 0.170669 Jul 27 07:56:59.502922 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 431/884] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Jul 27 07:56:59 2022] DELETE /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/os-volume_attachments/8ea21f82-ce86-4800-8924-54d7fb5baedd => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 07:56:59.511797 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-085f9552-131e-4e5b-8ffe-c83e1e9ea755 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:59.514305 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-085f9552-131e-4e5b-8ffe-c83e1e9ea755 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:59.520742 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-085f9552-131e-4e5b-8ffe-c83e1e9ea755 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:59.521231 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-085f9552-131e-4e5b-8ffe-c83e1e9ea755 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:59.522084 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-085f9552-131e-4e5b-8ffe-c83e1e9ea755 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:59.522565 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-085f9552-131e-4e5b-8ffe-c83e1e9ea755 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:59.554874 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-085f9552-131e-4e5b-8ffe-c83e1e9ea755 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047022 Jul 27 07:56:59.555493 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 454/885] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:56:59 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:56:59.581085 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-4840a0cd-adf7-449a-aa2b-cb51be1d1078 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:56:59.581857 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-4840a0cd-adf7-449a-aa2b-cb51be1d1078 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:56:59.588458 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4840a0cd-adf7-449a-aa2b-cb51be1d1078 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:59.588901 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4840a0cd-adf7-449a-aa2b-cb51be1d1078 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:59.589662 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4840a0cd-adf7-449a-aa2b-cb51be1d1078 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:56:59.590128 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4840a0cd-adf7-449a-aa2b-cb51be1d1078 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:56:59.719235 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-4840a0cd-adf7-449a-aa2b-cb51be1d1078 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:59.728046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-4840a0cd-adf7-449a-aa2b-cb51be1d1078 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:59.729591 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-4840a0cd-adf7-449a-aa2b-cb51be1d1078 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:56:59.730695 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-4840a0cd-adf7-449a-aa2b-cb51be1d1078 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1408 microversion: 2.20 time: 0.154326 Jul 27 07:56:59.731410 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 432/886] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:56:59 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:57:00.262022 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-24e9fcf8-24a5-46a8-95f3-d57d5c96c0a9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:00.262569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-24e9fcf8-24a5-46a8-95f3-d57d5c96c0a9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:00.269280 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-24e9fcf8-24a5-46a8-95f3-d57d5c96c0a9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:00.269734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-24e9fcf8-24a5-46a8-95f3-d57d5c96c0a9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:00.271220 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-24e9fcf8-24a5-46a8-95f3-d57d5c96c0a9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:00.271665 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-24e9fcf8-24a5-46a8-95f3-d57d5c96c0a9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:00.404788 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-24e9fcf8-24a5-46a8-95f3-d57d5c96c0a9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:00.412418 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-24e9fcf8-24a5-46a8-95f3-d57d5c96c0a9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1264 microversion: 2.1 time: 0.154354 Jul 27 07:57:00.412985 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 455/887] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:00 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:00.568087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-411f2502-da82-4aab-a81d-e04384ba2141 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:00.570356 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-411f2502-da82-4aab-a81d-e04384ba2141 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:00.577230 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-411f2502-da82-4aab-a81d-e04384ba2141 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:00.577702 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-411f2502-da82-4aab-a81d-e04384ba2141 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:00.578513 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-411f2502-da82-4aab-a81d-e04384ba2141 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:00.579035 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-411f2502-da82-4aab-a81d-e04384ba2141 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:00.611968 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-411f2502-da82-4aab-a81d-e04384ba2141 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048584 Jul 27 07:57:00.612511 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 433/888] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:57:00 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:57:00.752893 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-419e79ea-46fc-4977-9e1a-dc94b8eaa820 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:00.753504 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-419e79ea-46fc-4977-9e1a-dc94b8eaa820 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:00.760126 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-419e79ea-46fc-4977-9e1a-dc94b8eaa820 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:00.760583 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-419e79ea-46fc-4977-9e1a-dc94b8eaa820 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:00.761351 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-419e79ea-46fc-4977-9e1a-dc94b8eaa820 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:00.761786 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-419e79ea-46fc-4977-9e1a-dc94b8eaa820 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:00.894717 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-419e79ea-46fc-4977-9e1a-dc94b8eaa820 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:00.902846 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-419e79ea-46fc-4977-9e1a-dc94b8eaa820 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:00.904429 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-419e79ea-46fc-4977-9e1a-dc94b8eaa820 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:00.905534 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-419e79ea-46fc-4977-9e1a-dc94b8eaa820 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1408 microversion: 2.20 time: 0.156616 Jul 27 07:57:00.906137 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 456/889] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:57:00 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:57:01.432426 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ff92f119-ef55-4f17-b84e-0ceb6c07707e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:01.433047 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ff92f119-ef55-4f17-b84e-0ceb6c07707e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:01.439026 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ff92f119-ef55-4f17-b84e-0ceb6c07707e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:01.439471 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ff92f119-ef55-4f17-b84e-0ceb6c07707e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:01.440223 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ff92f119-ef55-4f17-b84e-0ceb6c07707e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:01.440651 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ff92f119-ef55-4f17-b84e-0ceb6c07707e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:01.575895 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ff92f119-ef55-4f17-b84e-0ceb6c07707e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:01.585444 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ff92f119-ef55-4f17-b84e-0ceb6c07707e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1264 microversion: 2.1 time: 0.156825 Jul 27 07:57:01.586014 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 434/890] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:01 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:01.624750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-233744d1-ba43-4f7c-9636-aa5fa00fc980 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:01.627016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-233744d1-ba43-4f7c-9636-aa5fa00fc980 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:01.634059 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-233744d1-ba43-4f7c-9636-aa5fa00fc980 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:01.634504 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-233744d1-ba43-4f7c-9636-aa5fa00fc980 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:01.635345 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-233744d1-ba43-4f7c-9636-aa5fa00fc980 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:01.635781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-233744d1-ba43-4f7c-9636-aa5fa00fc980 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:01.665628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-233744d1-ba43-4f7c-9636-aa5fa00fc980 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044781 Jul 27 07:57:01.666204 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 457/891] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:57:01 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:57:01.928592 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e2ce57fa-edd9-443c-9cca-7664baa26542 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:01.929203 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e2ce57fa-edd9-443c-9cca-7664baa26542 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:01.935301 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e2ce57fa-edd9-443c-9cca-7664baa26542 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:01.935752 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e2ce57fa-edd9-443c-9cca-7664baa26542 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:01.936515 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e2ce57fa-edd9-443c-9cca-7664baa26542 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:01.936953 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e2ce57fa-edd9-443c-9cca-7664baa26542 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:02.067455 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e2ce57fa-edd9-443c-9cca-7664baa26542 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:02.076133 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e2ce57fa-edd9-443c-9cca-7664baa26542 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:02.077742 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e2ce57fa-edd9-443c-9cca-7664baa26542 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:02.079008 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e2ce57fa-edd9-443c-9cca-7664baa26542 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1600 microversion: 2.20 time: 0.154423 Jul 27 07:57:02.079646 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 435/892] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:57:01 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:57:02.103374 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1d812988-1920-4e51-ab3f-8a4e3128f236 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:02.103898 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1d812988-1920-4e51-ab3f-8a4e3128f236 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:02.109997 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d812988-1920-4e51-ab3f-8a4e3128f236 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:02.110449 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d812988-1920-4e51-ab3f-8a4e3128f236 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:02.111271 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d812988-1920-4e51-ab3f-8a4e3128f236 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:02.111722 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d812988-1920-4e51-ab3f-8a4e3128f236 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:02.189902 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1d812988-1920-4e51-ab3f-8a4e3128f236 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091121 Jul 27 07:57:02.190497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 458/893] 10.222.0.18 () {60 vars in 1316 bytes} [Wed Jul 27 07:57:02 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 07:57:02.607894 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-98fae522-ea00-4da5-81cd-45bf73e683dd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:02.608512 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-98fae522-ea00-4da5-81cd-45bf73e683dd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:02.615143 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-98fae522-ea00-4da5-81cd-45bf73e683dd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:02.616100 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-98fae522-ea00-4da5-81cd-45bf73e683dd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:02.616874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-98fae522-ea00-4da5-81cd-45bf73e683dd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:02.617309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-98fae522-ea00-4da5-81cd-45bf73e683dd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:02.678693 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1d15caea-9ea7-4587-b8dd-57fdfe56174b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:02.681174 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1d15caea-9ea7-4587-b8dd-57fdfe56174b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:02.687452 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d15caea-9ea7-4587-b8dd-57fdfe56174b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:02.687991 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d15caea-9ea7-4587-b8dd-57fdfe56174b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:02.688844 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d15caea-9ea7-4587-b8dd-57fdfe56174b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:02.689288 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d15caea-9ea7-4587-b8dd-57fdfe56174b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:02.719899 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1d15caea-9ea7-4587-b8dd-57fdfe56174b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045904 Jul 27 07:57:02.726221 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 459/894] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:57:02 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 07:57:02.760836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-98fae522-ea00-4da5-81cd-45bf73e683dd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:02.763424 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:02.774253 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-98fae522-ea00-4da5-81cd-45bf73e683dd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1264 microversion: 2.1 time: 0.172364 Jul 27 07:57:02.774829 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 436/895] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:02 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:02.800158 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-24b77644-6b50-4291-ad9d-c5a0f7030a77 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:02.800657 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-24b77644-6b50-4291-ad9d-c5a0f7030a77 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:02.802610 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:02.807923 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-24b77644-6b50-4291-ad9d-c5a0f7030a77 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:02.808379 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-24b77644-6b50-4291-ad9d-c5a0f7030a77 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:02.809154 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-24b77644-6b50-4291-ad9d-c5a0f7030a77 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:02.809589 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-24b77644-6b50-4291-ad9d-c5a0f7030a77 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:02.838182 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-24b77644-6b50-4291-ad9d-c5a0f7030a77 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 07:57:02.917598 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-24b77644-6b50-4291-ad9d-c5a0f7030a77 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 204 len: 0 microversion: 2.1 time: 0.121038 Jul 27 07:57:02.921489 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 460/896] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 07:57:02 2022] DELETE /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 07:57:02.927162 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-21465d83-b40b-48d2-8e18-352fbbcaac8e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:02.927776 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-21465d83-b40b-48d2-8e18-352fbbcaac8e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:02.936371 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-21465d83-b40b-48d2-8e18-352fbbcaac8e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:02.936758 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-21465d83-b40b-48d2-8e18-352fbbcaac8e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:02.937539 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-21465d83-b40b-48d2-8e18-352fbbcaac8e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:02.937978 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-21465d83-b40b-48d2-8e18-352fbbcaac8e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:03.072018 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-21465d83-b40b-48d2-8e18-352fbbcaac8e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:03.079629 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-21465d83-b40b-48d2-8e18-352fbbcaac8e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1688 microversion: 2.1 time: 0.156984 Jul 27 07:57:03.080855 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 437/897] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:02 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:03.177879 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-f1b2cf96-e127-4952-a038-25a2a04b66ac req-4a41f3c9-1701-45ca-adb7-c44b5dbc0af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2", "tag": "19f48487-6051-4c27-9a27-015b3b0d174a"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:57:03.187969 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-f1b2cf96-e127-4952-a038-25a2a04b66ac req-4a41f3c9-1701-45ca-adb7-c44b5dbc0af9 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:03.188345 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-f1b2cf96-e127-4952-a038-25a2a04b66ac req-4a41f3c9-1701-45ca-adb7-c44b5dbc0af9 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:03.199355 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-f1b2cf96-e127-4952-a038-25a2a04b66ac req-4a41f3c9-1701-45ca-adb7-c44b5dbc0af9 service nova] Creating event network-changed:19f48487-6051-4c27-9a27-015b3b0d174a for instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 on hv-cinder-82549 Jul 27 07:57:03.204321 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-f1b2cf96-e127-4952-a038-25a2a04b66ac req-4a41f3c9-1701-45ca-adb7-c44b5dbc0af9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030566 Jul 27 07:57:03.204925 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 461/898] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:57:03.793018 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=2 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:03.793756 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=10 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:03.799124 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d19976b1-3100-4511-b546-ae5a4f6933fa tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:03.799883 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d19976b1-3100-4511-b546-ae5a4f6933fa tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:03.807821 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d19976b1-3100-4511-b546-ae5a4f6933fa tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:03.808277 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d19976b1-3100-4511-b546-ae5a4f6933fa tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:03.809118 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d19976b1-3100-4511-b546-ae5a4f6933fa tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:03.809568 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d19976b1-3100-4511-b546-ae5a4f6933fa tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:03.961553 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d19976b1-3100-4511-b546-ae5a4f6933fa tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:03.973716 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d19976b1-3100-4511-b546-ae5a4f6933fa tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1264 microversion: 2.1 time: 0.181528 Jul 27 07:57:03.974304 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 438/899] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:03 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:04.098562 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=10 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:04.103592 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b017aed7-7832-451a-8f0c-2362f02673e8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:04.104316 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b017aed7-7832-451a-8f0c-2362f02673e8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:04.111345 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b017aed7-7832-451a-8f0c-2362f02673e8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:04.111799 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b017aed7-7832-451a-8f0c-2362f02673e8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:04.112593 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b017aed7-7832-451a-8f0c-2362f02673e8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:04.113035 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b017aed7-7832-451a-8f0c-2362f02673e8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:04.248703 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b017aed7-7832-451a-8f0c-2362f02673e8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:04.257086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b017aed7-7832-451a-8f0c-2362f02673e8 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1688 microversion: 2.1 time: 0.159088 Jul 27 07:57:04.257659 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 462/900] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:04 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:04.993542 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d0c0a892-3807-450c-ad9d-25134c6a069d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:04.994153 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d0c0a892-3807-450c-ad9d-25134c6a069d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:05.000647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d0c0a892-3807-450c-ad9d-25134c6a069d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:05.001097 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d0c0a892-3807-450c-ad9d-25134c6a069d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:05.001858 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d0c0a892-3807-450c-ad9d-25134c6a069d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:05.002291 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d0c0a892-3807-450c-ad9d-25134c6a069d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:05.131054 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d0c0a892-3807-450c-ad9d-25134c6a069d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:05.138529 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d0c0a892-3807-450c-ad9d-25134c6a069d tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1264 microversion: 2.1 time: 0.148824 Jul 27 07:57:05.139127 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 439/901] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:04 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:05.278940 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2e590fb6-e4d2-47a5-ac83-9e9218556be4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:05.279471 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2e590fb6-e4d2-47a5-ac83-9e9218556be4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:05.285914 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2e590fb6-e4d2-47a5-ac83-9e9218556be4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:05.286355 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2e590fb6-e4d2-47a5-ac83-9e9218556be4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:05.287168 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2e590fb6-e4d2-47a5-ac83-9e9218556be4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:05.287710 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2e590fb6-e4d2-47a5-ac83-9e9218556be4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:05.417964 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2e590fb6-e4d2-47a5-ac83-9e9218556be4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:05.425632 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2e590fb6-e4d2-47a5-ac83-9e9218556be4 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1688 microversion: 2.1 time: 0.150710 Jul 27 07:57:05.426197 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 463/902] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:05 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:06.160054 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2aef9b2f-b270-420b-a2db-ff8ebc84cf50 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:06.160659 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2aef9b2f-b270-420b-a2db-ff8ebc84cf50 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:06.167654 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2aef9b2f-b270-420b-a2db-ff8ebc84cf50 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:06.168099 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2aef9b2f-b270-420b-a2db-ff8ebc84cf50 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:06.168853 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2aef9b2f-b270-420b-a2db-ff8ebc84cf50 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:06.169282 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2aef9b2f-b270-420b-a2db-ff8ebc84cf50 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:06.337717 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2aef9b2f-b270-420b-a2db-ff8ebc84cf50 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:06.345537 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2aef9b2f-b270-420b-a2db-ff8ebc84cf50 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1264 microversion: 2.1 time: 0.189274 Jul 27 07:57:06.346105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 440/903] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:06 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:06.446206 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-57273538-a942-4eb9-85e9-4267994bb941 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:06.446820 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-57273538-a942-4eb9-85e9-4267994bb941 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:06.453267 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-57273538-a942-4eb9-85e9-4267994bb941 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:06.453712 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-57273538-a942-4eb9-85e9-4267994bb941 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:06.454468 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-57273538-a942-4eb9-85e9-4267994bb941 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:06.454912 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-57273538-a942-4eb9-85e9-4267994bb941 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:06.586578 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-57273538-a942-4eb9-85e9-4267994bb941 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:06.594157 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-57273538-a942-4eb9-85e9-4267994bb941 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1688 microversion: 2.1 time: 0.151832 Jul 27 07:57:06.594722 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 464/904] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:06 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:07.367712 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-79db1f2a-8af2-4b42-a0e5-1077f2344677 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:07.368349 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-79db1f2a-8af2-4b42-a0e5-1077f2344677 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:07.375010 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-79db1f2a-8af2-4b42-a0e5-1077f2344677 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:07.375466 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-79db1f2a-8af2-4b42-a0e5-1077f2344677 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:07.376228 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-79db1f2a-8af2-4b42-a0e5-1077f2344677 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:07.376666 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-79db1f2a-8af2-4b42-a0e5-1077f2344677 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:07.509082 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-79db1f2a-8af2-4b42-a0e5-1077f2344677 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:07.516620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-79db1f2a-8af2-4b42-a0e5-1077f2344677 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1264 microversion: 2.1 time: 0.152797 Jul 27 07:57:07.517181 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 441/905] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:07 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:07.616207 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b9860d36-58af-47ee-8330-44b38da00e94 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:07.616841 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b9860d36-58af-47ee-8330-44b38da00e94 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:07.623390 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b9860d36-58af-47ee-8330-44b38da00e94 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:07.623769 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b9860d36-58af-47ee-8330-44b38da00e94 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:07.624551 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b9860d36-58af-47ee-8330-44b38da00e94 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:07.624983 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b9860d36-58af-47ee-8330-44b38da00e94 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:07.628858 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:07.759925 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b9860d36-58af-47ee-8330-44b38da00e94 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:07.767469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b9860d36-58af-47ee-8330-44b38da00e94 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1688 microversion: 2.1 time: 0.155153 Jul 27 07:57:07.768034 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 465/906] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:07 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:08.538861 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f1a93341-2887-480e-b02b-1e086cb40bfd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:08.539496 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f1a93341-2887-480e-b02b-1e086cb40bfd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:08.546842 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f1a93341-2887-480e-b02b-1e086cb40bfd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:08.547397 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f1a93341-2887-480e-b02b-1e086cb40bfd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:08.548421 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f1a93341-2887-480e-b02b-1e086cb40bfd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:08.548789 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f1a93341-2887-480e-b02b-1e086cb40bfd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:08.789539 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ffecd316-4f77-4a88-9f54-dfb0369b0960 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:08.790125 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ffecd316-4f77-4a88-9f54-dfb0369b0960 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:08.796913 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ffecd316-4f77-4a88-9f54-dfb0369b0960 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:08.797362 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ffecd316-4f77-4a88-9f54-dfb0369b0960 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:08.798136 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ffecd316-4f77-4a88-9f54-dfb0369b0960 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:08.798564 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ffecd316-4f77-4a88-9f54-dfb0369b0960 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:08.871220 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ffecd316-4f77-4a88-9f54-dfb0369b0960 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:08.879348 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ffecd316-4f77-4a88-9f54-dfb0369b0960 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 200 len: 1620 microversion: 2.1 time: 0.094433 Jul 27 07:57:08.880268 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 466/907] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:08 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 1620 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:57:09.070458 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f1a93341-2887-480e-b02b-1e086cb40bfd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:09.078186 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f1a93341-2887-480e-b02b-1e086cb40bfd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1264 microversion: 2.1 time: 0.544001 Jul 27 07:57:09.078776 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 442/908] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:08 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1264 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:09.304603 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-4d738fd1-6dd8-4d2e-9a0d-cfe6c68859d3 req-d79008fc-753f-4597-9cd6-f3f891005fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a94a8a11-679a-4c4c-b46b-c4a323068eb7", "name": "network-vif-deleted", "tag": "42c28b8b-6ebb-416e-b231-309016bdd31f"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:57:09.317545 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-4d738fd1-6dd8-4d2e-9a0d-cfe6c68859d3 req-d79008fc-753f-4597-9cd6-f3f891005fee service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:09.318003 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-4d738fd1-6dd8-4d2e-9a0d-cfe6c68859d3 req-d79008fc-753f-4597-9cd6-f3f891005fee service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:09.331451 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-4d738fd1-6dd8-4d2e-9a0d-cfe6c68859d3 req-d79008fc-753f-4597-9cd6-f3f891005fee service nova] Creating event network-vif-deleted:42c28b8b-6ebb-416e-b231-309016bdd31f for instance a94a8a11-679a-4c4c-b46b-c4a323068eb7 on hv-cinder-82549 Jul 27 07:57:09.337421 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-4d738fd1-6dd8-4d2e-9a0d-cfe6c68859d3 req-d79008fc-753f-4597-9cd6-f3f891005fee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038495 Jul 27 07:57:09.338405 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 467/909] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:57:09.902342 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ff2117b5-6a1f-47bc-9c3b-0cf142045706 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:09.904399 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ff2117b5-6a1f-47bc-9c3b-0cf142045706 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: a94a8a11-679a-4c4c-b46b-c4a323068eb7] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:09.914861 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ff2117b5-6a1f-47bc-9c3b-0cf142045706 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:09.915988 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ff2117b5-6a1f-47bc-9c3b-0cf142045706 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:09.917356 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ff2117b5-6a1f-47bc-9c3b-0cf142045706 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:09.918224 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ff2117b5-6a1f-47bc-9c3b-0cf142045706 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:09.940840 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-ff2117b5-6a1f-47bc-9c3b-0cf142045706 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] HTTP exception thrown: Instance a94a8a11-679a-4c4c-b46b-c4a323068eb7 could not be found. Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ff2117b5-6a1f-47bc-9c3b-0cf142045706 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Request method failure captured: Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 HTTP/1.1 Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O4UORz8wXhJ1kpiVNKXyE9VfzhMjRPMohCBHR61uSEgltK23AovTklhZktQwS1YkSIKv0p3xV2eZ4RBk4xLQVS9IMyH6g9DNMRWw9sV4BpxkaTRoJnwP5qMK153QRb-rvTyPfZE1GV6jzU-bzssuyWDHqvLNYZVXDmSYB5S7JuTYMo Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: c8e43fa41dc8445abed15accf9163b32 Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2087922844 Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 07:57:09.943275 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 07:57:09.945329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:57:09.945329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2087922844 Jul 27 07:57:09.945329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: c8e43fa41dc8445abed15accf9163b32 Jul 27 07:57:09.945329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2087922844 Jul 27 07:57:09.945329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-ServerRescueNegativeTestJSON-2087922844-project Jul 27 07:57:09.945329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 07:57:09.945329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 07:57:09.945329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: cb1cee30bc59446d882880d978b78bc2 Jul 27 07:57:09.945329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2087922844-project Jul 27 07:57:09.945329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 07:57:09.945329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Instance a94a8a11-679a-4c4c-b46b-c4a323068eb7 could not be found. Jul 27 07:57:09.945329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': 'a94a8a11-679a-4c4c-b46b-c4a323068eb7'} Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a94a8a11-679a-4c4c-b46b-c4a323068eb7 could not be found. Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:57:09.946362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:57:09.947954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:57:09.947954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 07:57:09.947954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 07:57:09.947954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 07:57:09.947954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 07:57:09.947954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 07:57:09.947954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:57:09.947954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a94a8a11-679a-4c4c-b46b-c4a323068eb7 could not be found. Jul 27 07:57:09.947954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:09.947954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:09.947954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:09.947954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:09.947954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:09.947954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:09.947954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:57:09.947954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:57:09.947954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a94a8a11-679a-4c4c-b46b-c4a323068eb7 could not be found. Jul 27 07:57:09.947954 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:09.949712 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ff2117b5-6a1f-47bc-9c3b-0cf142045706 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Returning 404 to user: Instance a94a8a11-679a-4c4c-b46b-c4a323068eb7 could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:57:09.949712 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ff2117b5-6a1f-47bc-9c3b-0cf142045706 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7" status: 404 len: 111 microversion: 2.1 time: 0.049037 Jul 27 07:57:09.949712 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 443/910] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:09 2022] GET /compute/v2.1/servers/a94a8a11-679a-4c4c-b46b-c4a323068eb7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 07:57:09.969248 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-998ef605-cfa8-44e7-9cd0-4fef417978cb tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '.version_select at 0x7f1a02b89310>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:09.993901 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-998ef605-cfa8-44e7-9cd0-4fef417978cb tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-523682687" status: 202 len: 0 microversion: 2.1 time: 0.041961 Jul 27 07:57:09.995033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 468/911] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Jul 27 07:57:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-523682687 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 07:57:10.106410 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f902d713-c38f-4a8a-a7f0-6ce8bae86882 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:10.107320 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f902d713-c38f-4a8a-a7f0-6ce8bae86882 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:10.116014 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f902d713-c38f-4a8a-a7f0-6ce8bae86882 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:10.116627 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f902d713-c38f-4a8a-a7f0-6ce8bae86882 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:10.117580 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f902d713-c38f-4a8a-a7f0-6ce8bae86882 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:10.118120 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f902d713-c38f-4a8a-a7f0-6ce8bae86882 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:10.317211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f902d713-c38f-4a8a-a7f0-6ce8bae86882 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:10.327988 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f902d713-c38f-4a8a-a7f0-6ce8bae86882 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1264 microversion: 2.1 time: 0.229287 Jul 27 07:57:10.338974 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 444/912] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:10 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:11.349362 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1e407fda-6093-4297-96ca-e0f3d6b43bc7 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:11.350146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1e407fda-6093-4297-96ca-e0f3d6b43bc7 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:11.357904 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e407fda-6093-4297-96ca-e0f3d6b43bc7 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:11.358361 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e407fda-6093-4297-96ca-e0f3d6b43bc7 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:11.359176 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e407fda-6093-4297-96ca-e0f3d6b43bc7 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:11.359621 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e407fda-6093-4297-96ca-e0f3d6b43bc7 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:11.493564 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1e407fda-6093-4297-96ca-e0f3d6b43bc7 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:11.501523 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1e407fda-6093-4297-96ca-e0f3d6b43bc7 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1264 microversion: 2.1 time: 0.155954 Jul 27 07:57:11.502303 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 469/913] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:11 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:12.304005 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-4a3b16b5-6893-42b0-9f27-a404287617cd req-ac15b367-bf2e-4fbc-a744-bf1bfd54f3ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420dfa7a-bd3b-4449-9928-620bf72f2725", "name": "network-vif-plugged", "status": "completed", "tag": "ad07f686-5948-477d-8818-90133cb4c39f"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:57:12.314575 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-4a3b16b5-6893-42b0-9f27-a404287617cd req-ac15b367-bf2e-4fbc-a744-bf1bfd54f3ab service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:12.315106 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-4a3b16b5-6893-42b0-9f27-a404287617cd req-ac15b367-bf2e-4fbc-a744-bf1bfd54f3ab service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:12.326732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-4a3b16b5-6893-42b0-9f27-a404287617cd req-ac15b367-bf2e-4fbc-a744-bf1bfd54f3ab service nova] Creating event network-vif-plugged:ad07f686-5948-477d-8818-90133cb4c39f for instance 420dfa7a-bd3b-4449-9928-620bf72f2725 on hv-cinder-82549 Jul 27 07:57:12.332142 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-4a3b16b5-6893-42b0-9f27-a404287617cd req-ac15b367-bf2e-4fbc-a744-bf1bfd54f3ab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033745 Jul 27 07:57:12.332808 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 445/914] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:57:12.523090 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6f2b5e84-c271-424e-8d3e-51b8c8ea67a0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:12.523712 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6f2b5e84-c271-424e-8d3e-51b8c8ea67a0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:12.530594 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6f2b5e84-c271-424e-8d3e-51b8c8ea67a0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:12.531081 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6f2b5e84-c271-424e-8d3e-51b8c8ea67a0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:12.531874 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6f2b5e84-c271-424e-8d3e-51b8c8ea67a0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:12.532309 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6f2b5e84-c271-424e-8d3e-51b8c8ea67a0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:12.684149 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6f2b5e84-c271-424e-8d3e-51b8c8ea67a0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:12.691810 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6f2b5e84-c271-424e-8d3e-51b8c8ea67a0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1264 microversion: 2.1 time: 0.173130 Jul 27 07:57:12.692394 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 470/915] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:12 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:12.915572 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-79189fae-a72c-48aa-affd-40cd37069e38 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:12.916159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-79189fae-a72c-48aa-affd-40cd37069e38 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:12.922621 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-79189fae-a72c-48aa-affd-40cd37069e38 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:12.923114 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-79189fae-a72c-48aa-affd-40cd37069e38 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:12.923890 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-79189fae-a72c-48aa-affd-40cd37069e38 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:12.924328 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-79189fae-a72c-48aa-affd-40cd37069e38 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:12.953220 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-79189fae-a72c-48aa-affd-40cd37069e38 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Going to try to terminate instance {{(pid=117779) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 07:57:13.033504 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-79189fae-a72c-48aa-affd-40cd37069e38 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "DELETE /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 204 len: 0 microversion: 2.1 time: 0.121881 Jul 27 07:57:13.034091 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 446/916] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 07:57:12 2022] DELETE /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 07:57:13.042348 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-543b86e6-f060-416f-9bf9-cdb6a103148b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:13.042998 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-543b86e6-f060-416f-9bf9-cdb6a103148b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:13.049074 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-543b86e6-f060-416f-9bf9-cdb6a103148b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:13.049518 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-543b86e6-f060-416f-9bf9-cdb6a103148b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:13.050278 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-543b86e6-f060-416f-9bf9-cdb6a103148b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:13.050711 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-543b86e6-f060-416f-9bf9-cdb6a103148b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:13.192692 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-543b86e6-f060-416f-9bf9-cdb6a103148b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:13.200825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-543b86e6-f060-416f-9bf9-cdb6a103148b tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1509 microversion: 2.1 time: 0.162377 Jul 27 07:57:13.201389 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 471/917] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:13 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:13.716736 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-eae7be5a-f206-4d63-aec8-221f414b981b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:13.717331 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-eae7be5a-f206-4d63-aec8-221f414b981b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:13.723872 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-eae7be5a-f206-4d63-aec8-221f414b981b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:13.724369 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-eae7be5a-f206-4d63-aec8-221f414b981b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:13.725182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-eae7be5a-f206-4d63-aec8-221f414b981b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:13.725617 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-eae7be5a-f206-4d63-aec8-221f414b981b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:13.856264 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-eae7be5a-f206-4d63-aec8-221f414b981b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:13.864065 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-eae7be5a-f206-4d63-aec8-221f414b981b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1264 microversion: 2.1 time: 0.151565 Jul 27 07:57:13.864641 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 447/918] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:13 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:57:14.221631 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-bb2b6c31-faf3-4d96-b139-678c44aa0492 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:14.222583 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-bb2b6c31-faf3-4d96-b139-678c44aa0492 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:14.229745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bb2b6c31-faf3-4d96-b139-678c44aa0492 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:14.230196 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bb2b6c31-faf3-4d96-b139-678c44aa0492 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:14.230990 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bb2b6c31-faf3-4d96-b139-678c44aa0492 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:14.231430 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bb2b6c31-faf3-4d96-b139-678c44aa0492 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:14.371867 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bb2b6c31-faf3-4d96-b139-678c44aa0492 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:14.380060 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-bb2b6c31-faf3-4d96-b139-678c44aa0492 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1509 microversion: 2.1 time: 0.162171 Jul 27 07:57:14.380705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 472/919] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:14 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:14.886290 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7dda1bd2-09c1-48b4-a222-6f8f2257de9f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:14.886929 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-7dda1bd2-09c1-48b4-a222-6f8f2257de9f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:14.893459 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7dda1bd2-09c1-48b4-a222-6f8f2257de9f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:14.893897 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7dda1bd2-09c1-48b4-a222-6f8f2257de9f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:14.894652 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7dda1bd2-09c1-48b4-a222-6f8f2257de9f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:14.895129 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7dda1bd2-09c1-48b4-a222-6f8f2257de9f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:15.132334 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7dda1bd2-09c1-48b4-a222-6f8f2257de9f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:15.140670 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7dda1bd2-09c1-48b4-a222-6f8f2257de9f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1449 microversion: 2.1 time: 0.258771 Jul 27 07:57:15.141259 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 448/920] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:14 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1449 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:15.162192 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-02ab2130-b8db-429f-8fce-032d415a17f5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:15.162812 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-02ab2130-b8db-429f-8fce-032d415a17f5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:15.169347 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-02ab2130-b8db-429f-8fce-032d415a17f5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:15.169828 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-02ab2130-b8db-429f-8fce-032d415a17f5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:15.170560 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-02ab2130-b8db-429f-8fce-032d415a17f5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:15.171029 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-02ab2130-b8db-429f-8fce-032d415a17f5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:15.305870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-02ab2130-b8db-429f-8fce-032d415a17f5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:15.313421 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-02ab2130-b8db-429f-8fce-032d415a17f5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1449 microversion: 2.1 time: 0.155041 Jul 27 07:57:15.313982 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 473/921] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:15 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:15.403606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-bd1f590c-ba76-4037-9c6e-f428baa16c13 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:15.405198 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-bd1f590c-ba76-4037-9c6e-f428baa16c13 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:15.416260 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bd1f590c-ba76-4037-9c6e-f428baa16c13 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:15.417003 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bd1f590c-ba76-4037-9c6e-f428baa16c13 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:15.418493 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bd1f590c-ba76-4037-9c6e-f428baa16c13 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:15.419576 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bd1f590c-ba76-4037-9c6e-f428baa16c13 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:15.440059 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-4354a645-6afd-468b-8df0-13c505a3c9fe req-636365a7-5de4-45b2-b28d-5ffa9527b9ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257c6f7b-d45d-499a-ade2-0b3371d09360", "name": "network-vif-deleted", "tag": "f9450ccc-33c3-4bb9-9fe8-897c11b4d17a"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:57:15.457506 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-4354a645-6afd-468b-8df0-13c505a3c9fe req-636365a7-5de4-45b2-b28d-5ffa9527b9ea service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:15.460743 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-4354a645-6afd-468b-8df0-13c505a3c9fe req-636365a7-5de4-45b2-b28d-5ffa9527b9ea service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:15.479728 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-4354a645-6afd-468b-8df0-13c505a3c9fe req-636365a7-5de4-45b2-b28d-5ffa9527b9ea service nova] Creating event network-vif-deleted:f9450ccc-33c3-4bb9-9fe8-897c11b4d17a for instance 257c6f7b-d45d-499a-ade2-0b3371d09360 on hv-cinder-82549 Jul 27 07:57:15.485285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-4354a645-6afd-468b-8df0-13c505a3c9fe req-636365a7-5de4-45b2-b28d-5ffa9527b9ea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049312 Jul 27 07:57:15.486556 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 474/922] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:57:15.495907 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-bd1f590c-ba76-4037-9c6e-f428baa16c13 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:15.506917 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-bd1f590c-ba76-4037-9c6e-f428baa16c13 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 200 len: 1467 microversion: 2.1 time: 0.108472 Jul 27 07:57:15.509702 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 449/923] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:15 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 1467 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:57:16.530664 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4c60ce6f-36dc-4cf2-b2ff-1fed362f315a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:16.531426 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4c60ce6f-36dc-4cf2-b2ff-1fed362f315a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 257c6f7b-d45d-499a-ade2-0b3371d09360] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:16.538758 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4c60ce6f-36dc-4cf2-b2ff-1fed362f315a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:16.539237 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4c60ce6f-36dc-4cf2-b2ff-1fed362f315a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:16.540007 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4c60ce6f-36dc-4cf2-b2ff-1fed362f315a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:16.540441 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4c60ce6f-36dc-4cf2-b2ff-1fed362f315a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:16.554548 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-4c60ce6f-36dc-4cf2-b2ff-1fed362f315a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] HTTP exception thrown: Instance 257c6f7b-d45d-499a-ade2-0b3371d09360 could not be found. Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4c60ce6f-36dc-4cf2-b2ff-1fed362f315a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Request method failure captured: Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 HTTP/1.1 Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O4UORz8wXhJ1kpiVNKXyE9VfzhMjRPMohCBHR61uSEgltK23AovTklhZktQwS1YkSIKv0p3xV2eZ4RBk4xLQVS9IMyH6g9DNMRWw9sV4BpxkaTRoJnwP5qMK153QRb-rvTyPfZE1GV6jzU-bzssuyWDHqvLNYZVXDmSYB5S7JuTYMo Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: c8e43fa41dc8445abed15accf9163b32 Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2087922844 Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 07:57:16.556216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 07:57:16.557734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:57:16.557734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2087922844 Jul 27 07:57:16.557734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: c8e43fa41dc8445abed15accf9163b32 Jul 27 07:57:16.557734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2087922844 Jul 27 07:57:16.557734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-ServerRescueNegativeTestJSON-2087922844-project Jul 27 07:57:16.557734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 07:57:16.557734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 07:57:16.557734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: cb1cee30bc59446d882880d978b78bc2 Jul 27 07:57:16.557734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2087922844-project Jul 27 07:57:16.557734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 07:57:16.557734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance 257c6f7b-d45d-499a-ade2-0b3371d09360 could not be found. Jul 27 07:57:16.557734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': '257c6f7b-d45d-499a-ade2-0b3371d09360'} Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 257c6f7b-d45d-499a-ade2-0b3371d09360 could not be found. Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:57:16.558497 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:57:16.559801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:57:16.559801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 07:57:16.559801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 07:57:16.559801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 07:57:16.559801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 07:57:16.559801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 07:57:16.559801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:57:16.559801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 257c6f7b-d45d-499a-ade2-0b3371d09360 could not be found. Jul 27 07:57:16.559801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:16.559801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:16.559801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:16.559801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:16.559801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:16.559801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:16.559801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:57:16.559801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:57:16.559801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 257c6f7b-d45d-499a-ade2-0b3371d09360 could not be found. Jul 27 07:57:16.559801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:16.560890 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4c60ce6f-36dc-4cf2-b2ff-1fed362f315a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Returning 404 to user: Instance 257c6f7b-d45d-499a-ade2-0b3371d09360 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:57:16.560890 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4c60ce6f-36dc-4cf2-b2ff-1fed362f315a tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360" status: 404 len: 111 microversion: 2.1 time: 0.031693 Jul 27 07:57:16.560890 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 475/924] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:16 2022] GET /compute/v2.1/servers/257c6f7b-d45d-499a-ade2-0b3371d09360 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 07:57:16.566409 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e0112ef3-4753-4c90-ac3d-a7b6ce4af0e0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:16.566964 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e0112ef3-4753-4c90-ac3d-a7b6ce4af0e0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:16.573980 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e0112ef3-4753-4c90-ac3d-a7b6ce4af0e0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:16.574429 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e0112ef3-4753-4c90-ac3d-a7b6ce4af0e0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:16.575242 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e0112ef3-4753-4c90-ac3d-a7b6ce4af0e0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:16.575682 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e0112ef3-4753-4c90-ac3d-a7b6ce4af0e0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:16.601173 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e0112ef3-4753-4c90-ac3d-a7b6ce4af0e0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Going to try to terminate instance {{(pid=117779) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 07:57:16.679380 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e0112ef3-4753-4c90-ac3d-a7b6ce4af0e0 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 204 len: 0 microversion: 2.1 time: 0.116491 Jul 27 07:57:16.680192 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 450/925] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 07:57:16 2022] DELETE /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 07:57:16.689364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a16914db-9156-4b73-acdf-6ae330770774 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:16.689989 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a16914db-9156-4b73-acdf-6ae330770774 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:16.696125 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a16914db-9156-4b73-acdf-6ae330770774 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:16.696576 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a16914db-9156-4b73-acdf-6ae330770774 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:16.697353 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a16914db-9156-4b73-acdf-6ae330770774 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:16.697795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a16914db-9156-4b73-acdf-6ae330770774 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:16.969970 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a16914db-9156-4b73-acdf-6ae330770774 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:16.978901 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a16914db-9156-4b73-acdf-6ae330770774 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.293726 Jul 27 07:57:16.979506 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 476/926] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:16 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:17.366693 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-2728af72-43f7-4de0-a814-9d10d6891a81 req-3e79aa48-1f34-4cff-9f24-25f346aa38f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420dfa7a-bd3b-4449-9928-620bf72f2725", "tag": "ad07f686-5948-477d-8818-90133cb4c39f"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:57:17.376134 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-2728af72-43f7-4de0-a814-9d10d6891a81 req-3e79aa48-1f34-4cff-9f24-25f346aa38f9 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:17.376661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-2728af72-43f7-4de0-a814-9d10d6891a81 req-3e79aa48-1f34-4cff-9f24-25f346aa38f9 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:17.388288 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-2728af72-43f7-4de0-a814-9d10d6891a81 req-3e79aa48-1f34-4cff-9f24-25f346aa38f9 service nova] Creating event network-changed:ad07f686-5948-477d-8818-90133cb4c39f for instance 420dfa7a-bd3b-4449-9928-620bf72f2725 on hv-cinder-82549 Jul 27 07:57:17.393103 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-2728af72-43f7-4de0-a814-9d10d6891a81 req-3e79aa48-1f34-4cff-9f24-25f346aa38f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030475 Jul 27 07:57:17.393694 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 451/927] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:57:18.000004 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-75c3666c-c25c-4958-8693-3d4656cf4b41 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:18.000594 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-75c3666c-c25c-4958-8693-3d4656cf4b41 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:18.007812 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-75c3666c-c25c-4958-8693-3d4656cf4b41 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:18.008270 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-75c3666c-c25c-4958-8693-3d4656cf4b41 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:18.009051 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-75c3666c-c25c-4958-8693-3d4656cf4b41 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:18.009492 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-75c3666c-c25c-4958-8693-3d4656cf4b41 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:18.142228 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-75c3666c-c25c-4958-8693-3d4656cf4b41 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:18.150329 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-75c3666c-c25c-4958-8693-3d4656cf4b41 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.154199 Jul 27 07:57:18.150934 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 477/928] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:17 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:18.481564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-fab0fa84-be0d-4478-a227-cce3443ddd8e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:18.483802 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-fab0fa84-be0d-4478-a227-cce3443ddd8e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:18.490298 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fab0fa84-be0d-4478-a227-cce3443ddd8e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:18.490789 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fab0fa84-be0d-4478-a227-cce3443ddd8e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:18.491621 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fab0fa84-be0d-4478-a227-cce3443ddd8e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:18.492058 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fab0fa84-be0d-4478-a227-cce3443ddd8e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:18.494621 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:18.523841 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-fab0fa84-be0d-4478-a227-cce3443ddd8e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046956 Jul 27 07:57:18.524462 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 452/929] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:57:18 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 07:57:18.588984 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-971183a1-c5ff-44bc-a42f-e88139ad25df tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:18.589485 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-971183a1-c5ff-44bc-a42f-e88139ad25df tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:18.595615 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-971183a1-c5ff-44bc-a42f-e88139ad25df tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:18.596070 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-971183a1-c5ff-44bc-a42f-e88139ad25df tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:18.597094 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-971183a1-c5ff-44bc-a42f-e88139ad25df tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:18.597532 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-971183a1-c5ff-44bc-a42f-e88139ad25df tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:18.622798 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-971183a1-c5ff-44bc-a42f-e88139ad25df tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 07:57:18.700052 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-971183a1-c5ff-44bc-a42f-e88139ad25df tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "DELETE /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 204 len: 0 microversion: 2.1 time: 0.114620 Jul 27 07:57:18.700630 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 478/930] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 07:57:18 2022] DELETE /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 07:57:18.709525 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f0585c9e-7872-4efa-bcb8-493f2a4e24b5 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:18.710171 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f0585c9e-7872-4efa-bcb8-493f2a4e24b5 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:18.716363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f0585c9e-7872-4efa-bcb8-493f2a4e24b5 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:18.716814 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f0585c9e-7872-4efa-bcb8-493f2a4e24b5 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:18.717579 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f0585c9e-7872-4efa-bcb8-493f2a4e24b5 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:18.718016 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f0585c9e-7872-4efa-bcb8-493f2a4e24b5 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:18.878399 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f0585c9e-7872-4efa-bcb8-493f2a4e24b5 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:18.886536 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f0585c9e-7872-4efa-bcb8-493f2a4e24b5 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1673 microversion: 2.1 time: 0.181445 Jul 27 07:57:18.887138 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 453/931] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:18 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:19.172519 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0cdbc7f2-b670-4c05-a6b2-8d7668715f3f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:19.173224 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0cdbc7f2-b670-4c05-a6b2-8d7668715f3f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:19.180291 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0cdbc7f2-b670-4c05-a6b2-8d7668715f3f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:19.180748 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0cdbc7f2-b670-4c05-a6b2-8d7668715f3f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:19.181509 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0cdbc7f2-b670-4c05-a6b2-8d7668715f3f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:19.181949 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0cdbc7f2-b670-4c05-a6b2-8d7668715f3f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:19.322267 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0cdbc7f2-b670-4c05-a6b2-8d7668715f3f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:19.330245 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0cdbc7f2-b670-4c05-a6b2-8d7668715f3f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.161937 Jul 27 07:57:19.330832 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 479/932] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:19 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:19.908195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d374ffa8-9be9-472e-b5de-fd07646dc894 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:19.908801 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d374ffa8-9be9-472e-b5de-fd07646dc894 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:19.915757 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d374ffa8-9be9-472e-b5de-fd07646dc894 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:19.916212 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d374ffa8-9be9-472e-b5de-fd07646dc894 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:19.916978 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d374ffa8-9be9-472e-b5de-fd07646dc894 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:19.917413 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d374ffa8-9be9-472e-b5de-fd07646dc894 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:20.049951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d374ffa8-9be9-472e-b5de-fd07646dc894 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:20.057970 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d374ffa8-9be9-472e-b5de-fd07646dc894 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1673 microversion: 2.1 time: 0.153717 Jul 27 07:57:20.058531 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 454/933] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:19 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:20.353727 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-147062e1-8513-4383-9141-c6fc3c706743 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:20.354330 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-147062e1-8513-4383-9141-c6fc3c706743 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:20.362178 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-147062e1-8513-4383-9141-c6fc3c706743 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:20.362178 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-147062e1-8513-4383-9141-c6fc3c706743 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:20.363627 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-147062e1-8513-4383-9141-c6fc3c706743 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:20.363627 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-147062e1-8513-4383-9141-c6fc3c706743 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:20.599816 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-147062e1-8513-4383-9141-c6fc3c706743 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:20.608136 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-147062e1-8513-4383-9141-c6fc3c706743 tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1522 microversion: 2.1 time: 0.258396 Jul 27 07:57:20.619304 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 480/934] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:20 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:21.002345 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-5eae4a6c-5212-460d-84e9-2239aa5f90a7 req-dc910ecb-a78c-4580-943c-e1928f2e30e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d14cae7-2ec9-4ab1-94c5-b63982ffc251", "name": "network-vif-deleted", "tag": "f7533591-85c2-41a4-9ada-d6c9eebf0053"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:57:21.020271 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-5eae4a6c-5212-460d-84e9-2239aa5f90a7 req-dc910ecb-a78c-4580-943c-e1928f2e30e7 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:21.020771 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-5eae4a6c-5212-460d-84e9-2239aa5f90a7 req-dc910ecb-a78c-4580-943c-e1928f2e30e7 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:21.034826 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-5eae4a6c-5212-460d-84e9-2239aa5f90a7 req-dc910ecb-a78c-4580-943c-e1928f2e30e7 service nova] Creating event network-vif-deleted:f7533591-85c2-41a4-9ada-d6c9eebf0053 for instance 0d14cae7-2ec9-4ab1-94c5-b63982ffc251 on hv-cinder-82549 Jul 27 07:57:21.042175 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-5eae4a6c-5212-460d-84e9-2239aa5f90a7 req-dc910ecb-a78c-4580-943c-e1928f2e30e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042826 Jul 27 07:57:21.043260 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 455/935] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:57:21.079858 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2092332d-f45f-44ab-94dc-b645186a0307 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:21.080690 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2092332d-f45f-44ab-94dc-b645186a0307 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:21.088065 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2092332d-f45f-44ab-94dc-b645186a0307 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:21.089317 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2092332d-f45f-44ab-94dc-b645186a0307 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:21.090109 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2092332d-f45f-44ab-94dc-b645186a0307 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:21.090727 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2092332d-f45f-44ab-94dc-b645186a0307 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:21.160241 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2092332d-f45f-44ab-94dc-b645186a0307 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:21.168358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2092332d-f45f-44ab-94dc-b645186a0307 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 200 len: 1605 microversion: 2.1 time: 0.092408 Jul 27 07:57:21.168933 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 481/936] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:21 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 1605 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:21.373381 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-084c87db-8879-4d8b-8967-2dd35ee07255 req-0a05264a-c9fd-4393-b162-7069b6b93dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480abe1b-7355-48b3-928a-4b32cc678979", "name": "network-vif-deleted", "tag": "25e0ce5d-89f2-4b0c-92d3-258760019eca"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:57:21.390141 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-084c87db-8879-4d8b-8967-2dd35ee07255 req-0a05264a-c9fd-4393-b162-7069b6b93dfe service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:21.390871 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-084c87db-8879-4d8b-8967-2dd35ee07255 req-0a05264a-c9fd-4393-b162-7069b6b93dfe service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:21.406547 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-084c87db-8879-4d8b-8967-2dd35ee07255 req-0a05264a-c9fd-4393-b162-7069b6b93dfe service nova] Creating event network-vif-deleted:25e0ce5d-89f2-4b0c-92d3-258760019eca for instance 480abe1b-7355-48b3-928a-4b32cc678979 on hv-cinder-82549 Jul 27 07:57:21.417777 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-084c87db-8879-4d8b-8967-2dd35ee07255 req-0a05264a-c9fd-4393-b162-7069b6b93dfe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048863 Jul 27 07:57:21.430426 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 456/937] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:57:21.629678 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-08569d18-35fe-44ac-b648-7ad43798095e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:21.630335 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-08569d18-35fe-44ac-b648-7ad43798095e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:21.636899 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-08569d18-35fe-44ac-b648-7ad43798095e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:21.637353 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-08569d18-35fe-44ac-b648-7ad43798095e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:21.638125 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-08569d18-35fe-44ac-b648-7ad43798095e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:21.638570 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-08569d18-35fe-44ac-b648-7ad43798095e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:21.677359 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-08569d18-35fe-44ac-b648-7ad43798095e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:21.677909 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-08569d18-35fe-44ac-b648-7ad43798095e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:21.678506 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-08569d18-35fe-44ac-b648-7ad43798095e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lazy-loading 'fault' on Instance uuid 0d14cae7-2ec9-4ab1-94c5-b63982ffc251 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:57:21.728300 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-08569d18-35fe-44ac-b648-7ad43798095e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb1cee30bc59446d882880d978b78bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e43fa41dc8445abed15accf9163b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:21.730692 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:21.737205 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-08569d18-35fe-44ac-b648-7ad43798095e tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 200 len: 1312 microversion: 2.1 time: 0.111466 Jul 27 07:57:21.737901 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 482/938] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:21 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 1312 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:22.190912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ecfbe20b-6567-48aa-80ea-3181a54881bb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:22.191628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ecfbe20b-6567-48aa-80ea-3181a54881bb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:22.198644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ecfbe20b-6567-48aa-80ea-3181a54881bb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:22.199182 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ecfbe20b-6567-48aa-80ea-3181a54881bb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:22.199956 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ecfbe20b-6567-48aa-80ea-3181a54881bb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:22.200384 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ecfbe20b-6567-48aa-80ea-3181a54881bb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:22.214437 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-ecfbe20b-6567-48aa-80ea-3181a54881bb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] HTTP exception thrown: Instance 480abe1b-7355-48b3-928a-4b32cc678979 could not be found. Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ecfbe20b-6567-48aa-80ea-3181a54881bb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Request method failure captured: Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 HTTP/1.1 Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O4OfPW-7ey2k6RWU-0v9cfXiXmuAJlvO5rk6pXP6-tSwUKoNK4aQm5qpWjXsuip_TKJKni_cb3HJC33b2C7rf8_dh1s6W6GH-eaApeWoHTsOSp7nbaSQymngYGN5G-4LyzHS_pDjg5-EA8ic1y_1V5sicu9dlRAj0WWm10ix3_R9Mk Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 88e9fffbb5c6457ca3bc45c6226230a3 Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-AttachVolumeTestJSON-195669691 Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 07:57:22.216046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 07:57:22.217688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:57:22.217688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-AttachVolumeTestJSON-195669691 Jul 27 07:57:22.217688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 88e9fffbb5c6457ca3bc45c6226230a3 Jul 27 07:57:22.217688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-AttachVolumeTestJSON-195669691 Jul 27 07:57:22.217688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-AttachVolumeTestJSON-195669691-project Jul 27 07:57:22.217688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 07:57:22.217688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 07:57:22.217688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: 7e3a5b392d9d44859110f048bea7331b Jul 27 07:57:22.217688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-AttachVolumeTestJSON-195669691-project Jul 27 07:57:22.217688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 07:57:22.217688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Instance 480abe1b-7355-48b3-928a-4b32cc678979 could not be found. Jul 27 07:57:22.217688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': '480abe1b-7355-48b3-928a-4b32cc678979'} Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480abe1b-7355-48b3-928a-4b32cc678979 could not be found. Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:57:22.218667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:57:22.220211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:57:22.220211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 07:57:22.220211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 07:57:22.220211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 07:57:22.220211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 07:57:22.220211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 07:57:22.220211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:57:22.220211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480abe1b-7355-48b3-928a-4b32cc678979 could not be found. Jul 27 07:57:22.220211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:22.220211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:22.220211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:22.220211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:22.220211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:22.220211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:22.220211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:57:22.220211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:57:22.220211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480abe1b-7355-48b3-928a-4b32cc678979 could not be found. Jul 27 07:57:22.220211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:22.221524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ecfbe20b-6567-48aa-80ea-3181a54881bb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Returning 404 to user: Instance 480abe1b-7355-48b3-928a-4b32cc678979 could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:57:22.221524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ecfbe20b-6567-48aa-80ea-3181a54881bb tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 404 len: 111 microversion: 2.1 time: 0.031251 Jul 27 07:57:22.221524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 457/939] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:22 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 07:57:22.226711 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a4a57b2d-f12f-4b35-a846-79c883c75265 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '.version_select at 0x7f19fe58b430>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:22.252020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a4a57b2d-f12f-4b35-a846-79c883c75265 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-238013743" status: 202 len: 0 microversion: 2.1 time: 0.029065 Jul 27 07:57:22.252609 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 483/940] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Jul 27 07:57:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-238013743 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 07:57:22.757620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d40f9b40-b33a-4c63-84a1-54a43553203f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:22.758230 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d40f9b40-b33a-4c63-84a1-54a43553203f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] [instance: 0d14cae7-2ec9-4ab1-94c5-b63982ffc251] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:22.764280 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d40f9b40-b33a-4c63-84a1-54a43553203f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:22.764770 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d40f9b40-b33a-4c63-84a1-54a43553203f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:22.765543 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d40f9b40-b33a-4c63-84a1-54a43553203f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:22.765977 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d40f9b40-b33a-4c63-84a1-54a43553203f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:22.786055 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-d40f9b40-b33a-4c63-84a1-54a43553203f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] HTTP exception thrown: Instance 0d14cae7-2ec9-4ab1-94c5-b63982ffc251 could not be found. Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d40f9b40-b33a-4c63-84a1-54a43553203f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Request method failure captured: Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 HTTP/1.1 Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O4UORz8wXhJ1kpiVNKXyE9VfzhMjRPMohCBHR61uSEgltK23AovTklhZktQwS1YkSIKv0p3xV2eZ4RBk4xLQVS9IMyH6g9DNMRWw9sV4BpxkaTRoJnwP5qMK153QRb-rvTyPfZE1GV6jzU-bzssuyWDHqvLNYZVXDmSYB5S7JuTYMo Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: c8e43fa41dc8445abed15accf9163b32 Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2087922844 Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 07:57:22.788195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 07:57:22.789804 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c8e43fa41dc8445abed15accf9163b32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:57:22.789804 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2087922844 Jul 27 07:57:22.789804 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: c8e43fa41dc8445abed15accf9163b32 Jul 27 07:57:22.789804 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2087922844 Jul 27 07:57:22.789804 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-ServerRescueNegativeTestJSON-2087922844-project Jul 27 07:57:22.789804 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 07:57:22.789804 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 07:57:22.789804 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: cb1cee30bc59446d882880d978b78bc2 Jul 27 07:57:22.789804 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2087922844-project Jul 27 07:57:22.789804 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 07:57:22.789804 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Instance 0d14cae7-2ec9-4ab1-94c5-b63982ffc251 could not be found. Jul 27 07:57:22.789804 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': '0d14cae7-2ec9-4ab1-94c5-b63982ffc251'} Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d14cae7-2ec9-4ab1-94c5-b63982ffc251 could not be found. Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:57:22.790732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:57:22.792087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:57:22.792087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 07:57:22.792087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 07:57:22.792087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 07:57:22.792087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 07:57:22.792087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 07:57:22.792087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:57:22.792087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d14cae7-2ec9-4ab1-94c5-b63982ffc251 could not be found. Jul 27 07:57:22.792087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:22.792087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:22.792087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:22.792087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:22.792087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:22.792087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:22.792087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:57:22.792087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:57:22.792087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d14cae7-2ec9-4ab1-94c5-b63982ffc251 could not be found. Jul 27 07:57:22.792087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:22.793313 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d40f9b40-b33a-4c63-84a1-54a43553203f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] Returning 404 to user: Instance 0d14cae7-2ec9-4ab1-94c5-b63982ffc251 could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:57:22.793313 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d40f9b40-b33a-4c63-84a1-54a43553203f tempest-ServerRescueNegativeTestJSON-2087922844 tempest-ServerRescueNegativeTestJSON-2087922844-project] 10.222.0.18 "GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251" status: 404 len: 111 microversion: 2.1 time: 0.035920 Jul 27 07:57:22.793313 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 458/941] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:22 2022] GET /compute/v2.1/servers/0d14cae7-2ec9-4ab1-94c5-b63982ffc251 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 07:57:22.919249 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-88b466eb-b233-4730-9c75-a1065461907f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Action: 'create', calling method: .version_select at 0x7f1a02b894c0>, body: {"keypair": {"name": "tempest-keypair-1375459936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+eCHAF+H0dOI2zxNQRjD9z31nKDhb9lmzpO6bBgtfpW8XRfyhEerJWUxvvhhqGqsaz6q1cB4EL/ALMDCOK6Y8gTDRwb7K4QK1hFa9C8vEteaAzUYVrIa2s4AP4fc2vHw=="}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:57:22.937627 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-88b466eb-b233-4730-9c75-a1065461907f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Getting quotas for project 88e9fffbb5c6457ca3bc45c6226230a3. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:57:22.941534 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-88b466eb-b233-4730-9c75-a1065461907f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Getting quotas for user 7e3a5b392d9d44859110f048bea7331b and project 88e9fffbb5c6457ca3bc45c6226230a3. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:57:22.964156 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-88b466eb-b233-4730-9c75-a1065461907f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049625 Jul 27 07:57:22.964944 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 484/942] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Jul 27 07:57:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:57:24.478963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9165e7b9-cdd5-439b-a797-50e48f32296c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-695588699", "imageRef": "646bfb5d-ef25-404a-a432-35d4209840fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9824a9e9-8b2a-4b9d-b805-9d8ca503fdb9"}], "security_groups": [{"name": "tempest-securitygroup--421852509"}], "key_name": "tempest-keypair-1375459936", "user_data": "}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:57:24.585526 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.network.neutron [None req-9165e7b9-cdd5-439b-a797-50e48f32296c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] validate_networks() for [('9824a9e9-8b2a-4b9d-b805-9d8ca503fdb9', None, None, None, None, None)] {{(pid=117779) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:57:24.979926 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-9165e7b9-cdd5-439b-a797-50e48f32296c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Flavor limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:57:24.980602 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-9165e7b9-cdd5-439b-a797-50e48f32296c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Image limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:57:24.981228 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-9165e7b9-cdd5-439b-a797-50e48f32296c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Flavor pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:57:24.982447 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-9165e7b9-cdd5-439b-a797-50e48f32296c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Image pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:57:24.983055 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-9165e7b9-cdd5-439b-a797-50e48f32296c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:57:24.994194 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9165e7b9-cdd5-439b-a797-50e48f32296c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:24.994874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9165e7b9-cdd5-439b-a797-50e48f32296c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:24.995970 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9165e7b9-cdd5-439b-a797-50e48f32296c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:24.996598 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9165e7b9-cdd5-439b-a797-50e48f32296c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:25.015322 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-9165e7b9-cdd5-439b-a797-50e48f32296c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Getting quotas for project 88e9fffbb5c6457ca3bc45c6226230a3. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:57:25.020138 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-9165e7b9-cdd5-439b-a797-50e48f32296c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Getting quotas for user 7e3a5b392d9d44859110f048bea7331b and project 88e9fffbb5c6457ca3bc45c6226230a3. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:57:25.033974 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-9165e7b9-cdd5-439b-a797-50e48f32296c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Going to run 1 instances... {{(pid=117779) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:57:25.037728 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-9165e7b9-cdd5-439b-a797-50e48f32296c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='646bfb5d-ef25-404a-a432-35d4209840fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:57:25.092863 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9165e7b9-cdd5-439b-a797-50e48f32296c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.617686 Jul 27 07:57:25.094087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 459/943] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 07:57:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 07:57:25.104685 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-44cd4e07-bf1e-4504-94ea-af343b0765a6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:25.105930 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-44cd4e07-bf1e-4504-94ea-af343b0765a6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:25.274684 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-44cd4e07-bf1e-4504-94ea-af343b0765a6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:25.285565 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-44cd4e07-bf1e-4504-94ea-af343b0765a6 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 200 len: 1237 microversion: 2.1 time: 0.184320 Jul 27 07:57:25.287843 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 485/944] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:25 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 1237 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:26.309183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-32be9fa2-9dbe-44b8-9d6f-3942412d9697 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:26.309947 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-32be9fa2-9dbe-44b8-9d6f-3942412d9697 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:26.316774 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-32be9fa2-9dbe-44b8-9d6f-3942412d9697 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:26.317230 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-32be9fa2-9dbe-44b8-9d6f-3942412d9697 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:26.318547 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-32be9fa2-9dbe-44b8-9d6f-3942412d9697 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:26.319014 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-32be9fa2-9dbe-44b8-9d6f-3942412d9697 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:26.394461 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-32be9fa2-9dbe-44b8-9d6f-3942412d9697 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:26.404875 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-32be9fa2-9dbe-44b8-9d6f-3942412d9697 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 200 len: 1307 microversion: 2.1 time: 0.099556 Jul 27 07:57:26.405740 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 460/945] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:26 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:27.432519 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-40e8f205-1355-42b1-a350-12d5b6ddd62e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:27.433052 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-40e8f205-1355-42b1-a350-12d5b6ddd62e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:27.440304 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-40e8f205-1355-42b1-a350-12d5b6ddd62e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:27.440886 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-40e8f205-1355-42b1-a350-12d5b6ddd62e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:27.441668 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-40e8f205-1355-42b1-a350-12d5b6ddd62e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:27.442177 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-40e8f205-1355-42b1-a350-12d5b6ddd62e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:27.687259 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-40e8f205-1355-42b1-a350-12d5b6ddd62e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:27.696055 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-40e8f205-1355-42b1-a350-12d5b6ddd62e tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 200 len: 1362 microversion: 2.1 time: 0.274454 Jul 27 07:57:27.696627 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 486/946] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:27 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:28.055779 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-f3b06d9c-710f-445f-8781-b3b8812c4b2a req-a3f7b134-a7fb-4e97-b22e-dbefdd40facb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57b781f2-0fd1-4873-9236-e01b979ce080", "tag": "fa40185e-3939-4e43-9d50-057280d094bd"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:57:28.073264 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-f3b06d9c-710f-445f-8781-b3b8812c4b2a req-a3f7b134-a7fb-4e97-b22e-dbefdd40facb service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:28.073985 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-f3b06d9c-710f-445f-8781-b3b8812c4b2a req-a3f7b134-a7fb-4e97-b22e-dbefdd40facb service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:28.090389 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-f3b06d9c-710f-445f-8781-b3b8812c4b2a req-a3f7b134-a7fb-4e97-b22e-dbefdd40facb service nova] Creating event network-changed:fa40185e-3939-4e43-9d50-057280d094bd for instance 57b781f2-0fd1-4873-9236-e01b979ce080 on hv-cinder-82549 Jul 27 07:57:28.093770 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-611e52ba-2dc1-4ed5-966d-f49d9bc7c969 tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] Action: 'create', calling method: .version_select at 0x7f19fe37f4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1286020760", "metadata": {"Type": "work"}}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:57:28.095579 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-f3b06d9c-710f-445f-8781-b3b8812c4b2a req-a3f7b134-a7fb-4e97-b22e-dbefdd40facb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045090 Jul 27 07:57:28.096581 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 487/947] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-611e52ba-2dc1-4ed5-966d-f49d9bc7c969 tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] Request method failure captured: Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 122 Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O_njdEra3mmUJyVgRktDHSDy7IoRiFRPPlHzH3wfgyO9NvjqYpwXlQKjTq2sr_GkTV5KyLRQUmJj6W_63V0-DITHnl88xxUCzOPskzbMjLZR7xltUOe5imMed6eMAPD-qAAY0mps-fNBOW78wXwspZ-DrKcMxJW5NqPcL1JGAFiiDk Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 0414303787b14430b270aa3f356d23b5 Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-VolumesNegativeTest-436081126 Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 07:57:28.124620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 07:57:28.126765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0414303787b14430b270aa3f356d23b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0414303787b14430b270aa3f356d23b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0414303787b14430b270aa3f356d23b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0414303787b14430b270aa3f356d23b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:57:28.126765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-VolumesNegativeTest-436081126 Jul 27 07:57:28.126765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 0414303787b14430b270aa3f356d23b5 Jul 27 07:57:28.126765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-VolumesNegativeTest-436081126 Jul 27 07:57:28.126765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-VolumesNegativeTest-436081126-project Jul 27 07:57:28.126765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 07:57:28.126765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 07:57:28.126765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: 44029f6115b14b4ba36c66871d43a188 Jul 27 07:57:28.126765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-VolumesNegativeTest-436081126-project Jul 27 07:57:28.126765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Jul 27 07:57:28.126765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1286020760", "metadata": {"Type": "work"}}} Jul 27 07:57:28.126765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: Jul 27 07:57:28.126765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1286020760', 'metadata': {'Type': 'work'}}}} Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise error Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi '#$%' Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:57:28.127992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:57:28.129647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 07:57:28.129647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 07:57:28.129647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:57:28.129647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:57:28.129647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 07:57:28.129647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 07:57:28.129647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 07:57:28.129647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 07:57:28.129647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 07:57:28.129647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 07:57:28.129647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 07:57:28.129647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.129647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:28.129647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.129647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.129647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:28.129647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:28.129647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 07:57:28.129647 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 07:57:28.131456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 07:57:28.131456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.131456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-611e52ba-2dc1-4ed5-966d-f49d9bc7c969 tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:57:28.134001 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-611e52ba-2dc1-4ed5-966d-f49d9bc7c969 tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.244463 Jul 27 07:57:28.138962 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 461/948] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Jul 27 07:57:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 251 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 07:57:28.146771 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e0f295fa-6c24-4c25-9068-825d1bc5f52d tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] Action: 'create', calling method: .version_select at 0x7f19fe582ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1044976530", "metadata": {"Type": "work"}}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e0f295fa-6c24-4c25-9068-825d1bc5f52d tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] Request method failure captured: Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 120 Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O_njdEra3mmUJyVgRktDHSDy7IoRiFRPPlHzH3wfgyO9NvjqYpwXlQKjTq2sr_GkTV5KyLRQUmJj6W_63V0-DITHnl88xxUCzOPskzbMjLZR7xltUOe5imMed6eMAPD-qAAY0mps-fNBOW78wXwspZ-DrKcMxJW5NqPcL1JGAFiiDk Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 0414303787b14430b270aa3f356d23b5 Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesNegativeTest-436081126 Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 07:57:28.152650 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 07:57:28.154320 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0414303787b14430b270aa3f356d23b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0414303787b14430b270aa3f356d23b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0414303787b14430b270aa3f356d23b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0414303787b14430b270aa3f356d23b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:57:28.154320 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesNegativeTest-436081126 Jul 27 07:57:28.154320 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 0414303787b14430b270aa3f356d23b5 Jul 27 07:57:28.154320 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesNegativeTest-436081126 Jul 27 07:57:28.154320 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesNegativeTest-436081126-project Jul 27 07:57:28.154320 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 07:57:28.154320 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 07:57:28.154320 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: 44029f6115b14b4ba36c66871d43a188 Jul 27 07:57:28.154320 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesNegativeTest-436081126-project Jul 27 07:57:28.154320 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Jul 27 07:57:28.154320 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1044976530", "metadata": {"Type": "work"}}} Jul 27 07:57:28.154320 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: Jul 27 07:57:28.154320 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1044976530', 'metadata': {'Type': 'work'}}}} Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise error Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi '0' Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:57:28.155337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:57:28.156959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 07:57:28.156959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 07:57:28.156959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:57:28.156959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:57:28.156959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 07:57:28.156959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 07:57:28.156959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 07:57:28.156959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 07:57:28.156959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 07:57:28.156959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 07:57:28.156959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 07:57:28.156959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.156959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:28.156959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.156959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.156959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:28.156959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:28.156959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 07:57:28.156959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 07:57:28.158350 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 07:57:28.158350 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.158350 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e0f295fa-6c24-4c25-9068-825d1bc5f52d tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:57:28.159407 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e0f295fa-6c24-4c25-9068-825d1bc5f52d tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017318 Jul 27 07:57:28.162861 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 488/949] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Jul 27 07:57:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 07:57:28.169362 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7224a7d5-d021-4f27-897b-ff899f55fc2e tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] Action: 'create', calling method: .version_select at 0x7f19fe2d3a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1274674727", "metadata": {"Type": "work"}}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7224a7d5-d021-4f27-897b-ff899f55fc2e tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] Request method failure captured: Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 119 Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O_njdEra3mmUJyVgRktDHSDy7IoRiFRPPlHzH3wfgyO9NvjqYpwXlQKjTq2sr_GkTV5KyLRQUmJj6W_63V0-DITHnl88xxUCzOPskzbMjLZR7xltUOe5imMed6eMAPD-qAAY0mps-fNBOW78wXwspZ-DrKcMxJW5NqPcL1JGAFiiDk Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 0414303787b14430b270aa3f356d23b5 Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-VolumesNegativeTest-436081126 Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 07:57:28.173309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 07:57:28.174903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0414303787b14430b270aa3f356d23b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0414303787b14430b270aa3f356d23b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0414303787b14430b270aa3f356d23b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0414303787b14430b270aa3f356d23b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:57:28.174903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-VolumesNegativeTest-436081126 Jul 27 07:57:28.174903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 0414303787b14430b270aa3f356d23b5 Jul 27 07:57:28.174903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-VolumesNegativeTest-436081126 Jul 27 07:57:28.174903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-VolumesNegativeTest-436081126-project Jul 27 07:57:28.174903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 07:57:28.174903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 07:57:28.174903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: 44029f6115b14b4ba36c66871d43a188 Jul 27 07:57:28.174903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-VolumesNegativeTest-436081126-project Jul 27 07:57:28.174903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Jul 27 07:57:28.174903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1274674727", "metadata": {"Type": "work"}}} Jul 27 07:57:28.174903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: Jul 27 07:57:28.174903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1274674727', 'metadata': {'Type': 'work'}}}} Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise error Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi '' Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:57:28.175948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:57:28.177333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 07:57:28.177333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 07:57:28.177333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:57:28.177333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:57:28.177333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 07:57:28.177333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 07:57:28.177333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 07:57:28.177333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 07:57:28.177333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 07:57:28.177333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 07:57:28.177333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 07:57:28.177333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.177333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:28.177333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.177333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.177333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:28.177333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:28.177333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 07:57:28.177333 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 07:57:28.178515 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 07:57:28.178515 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.178515 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7224a7d5-d021-4f27-897b-ff899f55fc2e tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:57:28.178515 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7224a7d5-d021-4f27-897b-ff899f55fc2e tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009325 Jul 27 07:57:28.178515 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 462/950] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Jul 27 07:57:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 27 07:57:28.185388 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-17063804-bc7e-4302-b958-499f1259085e tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] Calling method '.version_select at 0x7f19fe4f41f0>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:28.217419 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-17063804-bc7e-4302-b958-499f1259085e tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] HTTP exception thrown: Volume tempest-invalid-153042446 could not be found. Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-17063804-bc7e-4302-b958-499f1259085e tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] Request method failure captured: Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-153042446 HTTP/1.1 Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O_njdEra3mmUJyVgRktDHSDy7IoRiFRPPlHzH3wfgyO9NvjqYpwXlQKjTq2sr_GkTV5KyLRQUmJj6W_63V0-DITHnl88xxUCzOPskzbMjLZR7xltUOe5imMed6eMAPD-qAAY0mps-fNBOW78wXwspZ-DrKcMxJW5NqPcL1JGAFiiDk Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 0414303787b14430b270aa3f356d23b5 Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesNegativeTest-436081126 Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 07:57:28.224741 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 07:57:28.226423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0414303787b14430b270aa3f356d23b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0414303787b14430b270aa3f356d23b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0414303787b14430b270aa3f356d23b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0414303787b14430b270aa3f356d23b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:57:28.226423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesNegativeTest-436081126 Jul 27 07:57:28.226423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 0414303787b14430b270aa3f356d23b5 Jul 27 07:57:28.226423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesNegativeTest-436081126 Jul 27 07:57:28.226423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesNegativeTest-436081126-project Jul 27 07:57:28.226423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 07:57:28.226423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 07:57:28.226423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: 44029f6115b14b4ba36c66871d43a188 Jul 27 07:57:28.226423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesNegativeTest-436081126-project Jul 27 07:57:28.226423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: Jul 27 07:57:28.226423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Volume tempest-invalid-153042446 could not be found. Jul 27 07:57:28.226423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': 'tempest-invalid-153042446'} Jul 27 07:57:28.226423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:57:28.227469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.227469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 07:57:28.227469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 07:57:28.227469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 07:57:28.227469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 07:57:28.227469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 07:57:28.227469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 07:57:28.227469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 07:57:28.227469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 07:57:28.227469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 07:57:28.227469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 07:57:28.227469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 07:57:28.227469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 07:57:28.227469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 07:57:28.227469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 07:57:28.227469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-153042446 could not be found. (HTTP 404) (Request-ID: req-bf785118-3aab-495c-89a2-ba67777fd92e) Jul 27 07:57:28.227469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.227469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:28.227469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.228974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.228974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 07:57:28.228974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 07:57:28.228974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 07:57:28.228974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 07:57:28.228974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 07:57:28.228974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 07:57:28.228974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 07:57:28.228974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 07:57:28.228974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 07:57:28.228974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 07:57:28.228974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 07:57:28.228974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 07:57:28.228974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 07:57:28.228974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 07:57:28.228974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 07:57:28.228974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 07:57:28.228974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 07:57:28.228974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-153042446 could not be found. Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:57:28.230484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-153042446 could not be found. Jul 27 07:57:28.231992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.231992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:28.231992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.231992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.231992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:28.231992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:28.231992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:57:28.231992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:57:28.231992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-153042446 could not be found. Jul 27 07:57:28.231992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.231992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-17063804-bc7e-4302-b958-499f1259085e tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] Returning 404 to user: Volume tempest-invalid-153042446 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:57:28.231992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-17063804-bc7e-4302-b958-499f1259085e tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-153042446" status: 404 len: 98 microversion: 2.1 time: 0.044716 Jul 27 07:57:28.231992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 489/951] 10.222.0.18 () {58 vars in 1215 bytes} [Wed Jul 27 07:57:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-153042446 => generated 98 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 27 07:57:28.236293 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-3b94d7c9-6859-4b13-b506-a34791335c60 tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004084 Jul 27 07:57:28.236862 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 463/952] 10.222.0.18 () {58 vars in 1140 bytes} [Wed Jul 27 07:57:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 27 07:57:28.247234 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-01429ecf-6977-4844-85b1-fb100433d7ed tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004962 Jul 27 07:57:28.247754 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 490/953] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Jul 27 07:57:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 27 07:57:28.257474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b188d9f0-7376-4cde-ba85-7684c3c38487 tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] Calling method '.version_select at 0x7f19fe3b1b80>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:28.286297 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-b188d9f0-7376-4cde-ba85-7684c3c38487 tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] HTTP exception thrown: Volume f4fbf50e-0691-4546-86a0-4dabe8e65823 could not be found. Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b188d9f0-7376-4cde-ba85-7684c3c38487 tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] Request method failure captured: Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: DELETE /compute/v2.1/os-volumes/f4fbf50e-0691-4546-86a0-4dabe8e65823 HTTP/1.1 Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O_njdEra3mmUJyVgRktDHSDy7IoRiFRPPlHzH3wfgyO9NvjqYpwXlQKjTq2sr_GkTV5KyLRQUmJj6W_63V0-DITHnl88xxUCzOPskzbMjLZR7xltUOe5imMed6eMAPD-qAAY0mps-fNBOW78wXwspZ-DrKcMxJW5NqPcL1JGAFiiDk Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 0414303787b14430b270aa3f356d23b5 Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-VolumesNegativeTest-436081126 Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 07:57:28.289606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 07:57:28.291200 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0414303787b14430b270aa3f356d23b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0414303787b14430b270aa3f356d23b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0414303787b14430b270aa3f356d23b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0414303787b14430b270aa3f356d23b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:57:28.291200 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-VolumesNegativeTest-436081126 Jul 27 07:57:28.291200 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 0414303787b14430b270aa3f356d23b5 Jul 27 07:57:28.291200 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-VolumesNegativeTest-436081126 Jul 27 07:57:28.291200 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-VolumesNegativeTest-436081126-project Jul 27 07:57:28.291200 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 07:57:28.291200 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 07:57:28.291200 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: 44029f6115b14b4ba36c66871d43a188 Jul 27 07:57:28.291200 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-VolumesNegativeTest-436081126-project Jul 27 07:57:28.291200 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: Jul 27 07:57:28.291200 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Volume f4fbf50e-0691-4546-86a0-4dabe8e65823 could not be found. Jul 27 07:57:28.291200 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': 'f4fbf50e-0691-4546-86a0-4dabe8e65823'} Jul 27 07:57:28.291200 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:57:28.292096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.292096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 07:57:28.292096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 07:57:28.292096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 07:57:28.292096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 07:57:28.292096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 07:57:28.292096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 07:57:28.292096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 07:57:28.292096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 07:57:28.292096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 07:57:28.292096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 07:57:28.292096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 07:57:28.292096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 07:57:28.292096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 07:57:28.292096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 07:57:28.292096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f4fbf50e-0691-4546-86a0-4dabe8e65823 could not be found. (HTTP 404) (Request-ID: req-ee5a0d3c-c685-4f98-8a44-4c4781cf96e8) Jul 27 07:57:28.292096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.292096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:28.292096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.293453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.293453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 07:57:28.293453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 07:57:28.293453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 07:57:28.293453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 07:57:28.293453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 07:57:28.293453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 07:57:28.293453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 07:57:28.293453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 07:57:28.293453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 07:57:28.293453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 07:57:28.293453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 07:57:28.293453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 07:57:28.293453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 07:57:28.293453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 07:57:28.293453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 07:57:28.293453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 07:57:28.293453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 07:57:28.293453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 07:57:28.294838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 07:57:28.294838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 07:57:28.294838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 07:57:28.294838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 07:57:28.294838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f4fbf50e-0691-4546-86a0-4dabe8e65823 could not be found. Jul 27 07:57:28.294838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.294838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:28.294838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.294838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.294838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:28.294838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:28.294838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:57:28.294838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:57:28.294838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 07:57:28.294838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 07:57:28.294838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:57:28.294838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:57:28.294838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 07:57:28.294838 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:57:28.296461 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f4fbf50e-0691-4546-86a0-4dabe8e65823 could not be found. Jul 27 07:57:28.296461 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.296461 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:28.296461 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.296461 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.296461 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:28.296461 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:28.296461 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:57:28.296461 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:57:28.296461 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f4fbf50e-0691-4546-86a0-4dabe8e65823 could not be found. Jul 27 07:57:28.296461 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.296461 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b188d9f0-7376-4cde-ba85-7684c3c38487 tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] Returning 404 to user: Volume f4fbf50e-0691-4546-86a0-4dabe8e65823 could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:57:28.296461 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b188d9f0-7376-4cde-ba85-7684c3c38487 tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/f4fbf50e-0691-4546-86a0-4dabe8e65823" status: 404 len: 109 microversion: 2.1 time: 0.037794 Jul 27 07:57:28.296461 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 464/954] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Jul 27 07:57:28 2022] DELETE /compute/v2.1/os-volumes/f4fbf50e-0691-4546-86a0-4dabe8e65823 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 07:57:28.303217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f1673f97-3c4b-4b8b-99af-c4487dc3cacf tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] Calling method '.version_select at 0x7f1a02c56e50>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:28.331464 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-f1673f97-3c4b-4b8b-99af-c4487dc3cacf tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] HTTP exception thrown: Volume cfbf790c-60d2-44ab-a06c-fbd1649738ad could not be found. Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f1673f97-3c4b-4b8b-99af-c4487dc3cacf tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] Request method failure captured: Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/os-volumes/cfbf790c-60d2-44ab-a06c-fbd1649738ad HTTP/1.1 Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O_njdEra3mmUJyVgRktDHSDy7IoRiFRPPlHzH3wfgyO9NvjqYpwXlQKjTq2sr_GkTV5KyLRQUmJj6W_63V0-DITHnl88xxUCzOPskzbMjLZR7xltUOe5imMed6eMAPD-qAAY0mps-fNBOW78wXwspZ-DrKcMxJW5NqPcL1JGAFiiDk Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 0414303787b14430b270aa3f356d23b5 Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesNegativeTest-436081126 Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 07:57:28.333557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 07:57:28.334961 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0414303787b14430b270aa3f356d23b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0414303787b14430b270aa3f356d23b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0414303787b14430b270aa3f356d23b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0414303787b14430b270aa3f356d23b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:57:28.334961 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesNegativeTest-436081126 Jul 27 07:57:28.334961 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 0414303787b14430b270aa3f356d23b5 Jul 27 07:57:28.334961 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesNegativeTest-436081126 Jul 27 07:57:28.334961 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesNegativeTest-436081126-project Jul 27 07:57:28.334961 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 07:57:28.334961 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 07:57:28.334961 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: 44029f6115b14b4ba36c66871d43a188 Jul 27 07:57:28.334961 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesNegativeTest-436081126-project Jul 27 07:57:28.334961 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: Jul 27 07:57:28.334961 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Volume cfbf790c-60d2-44ab-a06c-fbd1649738ad could not be found. Jul 27 07:57:28.334961 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': 'cfbf790c-60d2-44ab-a06c-fbd1649738ad'} Jul 27 07:57:28.334961 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:57:28.335790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.335790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 07:57:28.335790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 07:57:28.335790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 07:57:28.335790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 07:57:28.335790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 07:57:28.335790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 07:57:28.335790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 07:57:28.335790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 07:57:28.335790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 07:57:28.335790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 07:57:28.335790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 07:57:28.335790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 07:57:28.335790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 07:57:28.335790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 07:57:28.335790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cfbf790c-60d2-44ab-a06c-fbd1649738ad could not be found. (HTTP 404) (Request-ID: req-ef9eda9c-0463-4f43-a118-f4db6831747a) Jul 27 07:57:28.335790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.335790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:28.335790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.336988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.336988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 07:57:28.336988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 07:57:28.336988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 07:57:28.336988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 07:57:28.336988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 07:57:28.336988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 07:57:28.336988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 07:57:28.336988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 07:57:28.336988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 07:57:28.336988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 07:57:28.336988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 07:57:28.336988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 07:57:28.336988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 07:57:28.336988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 07:57:28.336988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 07:57:28.336988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 07:57:28.336988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 07:57:28.336988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 07:57:28.338119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 07:57:28.338119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 07:57:28.338119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 07:57:28.338119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 07:57:28.338119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cfbf790c-60d2-44ab-a06c-fbd1649738ad could not be found. Jul 27 07:57:28.338119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.338119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:28.338119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.338119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.338119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:28.338119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:28.338119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:57:28.338119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:57:28.338119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 07:57:28.338119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 07:57:28.338119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:57:28.338119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:57:28.338119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 07:57:28.338119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:57:28.339607 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cfbf790c-60d2-44ab-a06c-fbd1649738ad could not be found. Jul 27 07:57:28.339607 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.339607 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:57:28.339607 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.339607 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:57:28.339607 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:57:28.339607 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:57:28.339607 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:57:28.339607 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:57:28.339607 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cfbf790c-60d2-44ab-a06c-fbd1649738ad could not be found. Jul 27 07:57:28.339607 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:57:28.339607 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f1673f97-3c4b-4b8b-99af-c4487dc3cacf tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] Returning 404 to user: Volume cfbf790c-60d2-44ab-a06c-fbd1649738ad could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:57:28.339607 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f1673f97-3c4b-4b8b-99af-c4487dc3cacf tempest-VolumesNegativeTest-436081126 tempest-VolumesNegativeTest-436081126-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/cfbf790c-60d2-44ab-a06c-fbd1649738ad" status: 404 len: 109 microversion: 2.1 time: 0.036370 Jul 27 07:57:28.339607 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 491/955] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Jul 27 07:57:28 2022] GET /compute/v2.1/os-volumes/cfbf790c-60d2-44ab-a06c-fbd1649738ad => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 07:57:28.717418 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-bcfc0887-3d72-4ef5-913e-3a3cc49aa434 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:28.718034 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-bcfc0887-3d72-4ef5-913e-3a3cc49aa434 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:28.720802 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:28.726525 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bcfc0887-3d72-4ef5-913e-3a3cc49aa434 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:28.727036 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bcfc0887-3d72-4ef5-913e-3a3cc49aa434 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:28.727820 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bcfc0887-3d72-4ef5-913e-3a3cc49aa434 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:28.728264 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bcfc0887-3d72-4ef5-913e-3a3cc49aa434 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:28.872267 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-bcfc0887-3d72-4ef5-913e-3a3cc49aa434 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:28.881175 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-bcfc0887-3d72-4ef5-913e-3a3cc49aa434 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 200 len: 1362 microversion: 2.1 time: 0.167493 Jul 27 07:57:28.881758 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 465/956] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:28 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:29.902986 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d96796ab-59f7-4df3-b46e-b663a351105f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:29.903755 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d96796ab-59f7-4df3-b46e-b663a351105f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:29.910268 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d96796ab-59f7-4df3-b46e-b663a351105f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:29.910726 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d96796ab-59f7-4df3-b46e-b663a351105f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:29.911538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d96796ab-59f7-4df3-b46e-b663a351105f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:29.911987 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d96796ab-59f7-4df3-b46e-b663a351105f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:30.051070 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d96796ab-59f7-4df3-b46e-b663a351105f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:30.059241 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d96796ab-59f7-4df3-b46e-b663a351105f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 200 len: 1362 microversion: 2.1 time: 0.161408 Jul 27 07:57:30.059920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 492/957] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:29 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:31.081562 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-831d3eef-fdbd-41ff-a952-cae9b4ea7e0d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:31.082248 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-831d3eef-fdbd-41ff-a952-cae9b4ea7e0d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:31.089871 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-831d3eef-fdbd-41ff-a952-cae9b4ea7e0d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:31.090368 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-831d3eef-fdbd-41ff-a952-cae9b4ea7e0d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:31.091230 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-831d3eef-fdbd-41ff-a952-cae9b4ea7e0d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:31.091710 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-831d3eef-fdbd-41ff-a952-cae9b4ea7e0d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:31.228160 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-831d3eef-fdbd-41ff-a952-cae9b4ea7e0d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:31.235700 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-831d3eef-fdbd-41ff-a952-cae9b4ea7e0d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 200 len: 1362 microversion: 2.1 time: 0.158292 Jul 27 07:57:31.236270 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 466/958] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:31 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:32.257581 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f641dc38-4af0-4064-8b65-506b6e6d1393 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:32.258186 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f641dc38-4af0-4064-8b65-506b6e6d1393 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:32.265515 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f641dc38-4af0-4064-8b65-506b6e6d1393 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:32.265974 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f641dc38-4af0-4064-8b65-506b6e6d1393 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:32.266770 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f641dc38-4af0-4064-8b65-506b6e6d1393 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:32.267234 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f641dc38-4af0-4064-8b65-506b6e6d1393 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:32.399384 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f641dc38-4af0-4064-8b65-506b6e6d1393 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:32.406798 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f641dc38-4af0-4064-8b65-506b6e6d1393 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 200 len: 1362 microversion: 2.1 time: 0.153165 Jul 27 07:57:32.407477 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 493/959] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:32 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:33.428657 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-672529aa-9fd4-477d-a2dd-65ca40ee5f67 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:33.429270 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-672529aa-9fd4-477d-a2dd-65ca40ee5f67 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:33.436001 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-672529aa-9fd4-477d-a2dd-65ca40ee5f67 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:33.436441 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-672529aa-9fd4-477d-a2dd-65ca40ee5f67 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:33.437196 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-672529aa-9fd4-477d-a2dd-65ca40ee5f67 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:33.437623 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-672529aa-9fd4-477d-a2dd-65ca40ee5f67 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:33.577328 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-672529aa-9fd4-477d-a2dd-65ca40ee5f67 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:33.585672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-672529aa-9fd4-477d-a2dd-65ca40ee5f67 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 200 len: 1362 microversion: 2.1 time: 0.161084 Jul 27 07:57:33.586319 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 467/960] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:33 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:34.607584 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b5cdc7c2-25f1-47a6-a9b8-c338df208177 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:34.608220 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b5cdc7c2-25f1-47a6-a9b8-c338df208177 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:34.610623 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:34.616548 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b5cdc7c2-25f1-47a6-a9b8-c338df208177 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:34.616996 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b5cdc7c2-25f1-47a6-a9b8-c338df208177 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:34.617767 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b5cdc7c2-25f1-47a6-a9b8-c338df208177 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:34.618202 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b5cdc7c2-25f1-47a6-a9b8-c338df208177 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:34.752598 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b5cdc7c2-25f1-47a6-a9b8-c338df208177 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:34.760453 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b5cdc7c2-25f1-47a6-a9b8-c338df208177 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 200 len: 1362 microversion: 2.1 time: 0.156655 Jul 27 07:57:34.761030 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 494/961] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:34 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:35.781237 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b7571bdc-7ec1-46cc-8b64-0976343f83e2 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:35.781768 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b7571bdc-7ec1-46cc-8b64-0976343f83e2 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:35.784082 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=2 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:35.784748 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=6 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:35.791580 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b7571bdc-7ec1-46cc-8b64-0976343f83e2 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:35.792030 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b7571bdc-7ec1-46cc-8b64-0976343f83e2 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:35.792799 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b7571bdc-7ec1-46cc-8b64-0976343f83e2 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:35.793237 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b7571bdc-7ec1-46cc-8b64-0976343f83e2 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:35.924379 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b7571bdc-7ec1-46cc-8b64-0976343f83e2 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:35.934588 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b7571bdc-7ec1-46cc-8b64-0976343f83e2 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 200 len: 1362 microversion: 2.1 time: 0.157304 Jul 27 07:57:35.935195 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 468/962] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:35 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:36.956520 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0f09aedb-444d-4f73-824a-26c6bcea0622 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:36.957140 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0f09aedb-444d-4f73-824a-26c6bcea0622 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:36.959052 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=6 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:36.965161 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0f09aedb-444d-4f73-824a-26c6bcea0622 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:36.965611 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0f09aedb-444d-4f73-824a-26c6bcea0622 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:36.966377 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0f09aedb-444d-4f73-824a-26c6bcea0622 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:36.966812 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0f09aedb-444d-4f73-824a-26c6bcea0622 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:37.099249 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0f09aedb-444d-4f73-824a-26c6bcea0622 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:37.106581 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0f09aedb-444d-4f73-824a-26c6bcea0622 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 200 len: 1362 microversion: 2.1 time: 0.153960 Jul 27 07:57:37.107168 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 495/963] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:36 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:38.127644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0b4b5e1e-7bb4-4491-b86f-e390b029b6e8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:38.128446 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0b4b5e1e-7bb4-4491-b86f-e390b029b6e8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:38.135908 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0b4b5e1e-7bb4-4491-b86f-e390b029b6e8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:38.136361 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0b4b5e1e-7bb4-4491-b86f-e390b029b6e8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:38.137135 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0b4b5e1e-7bb4-4491-b86f-e390b029b6e8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:38.137579 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0b4b5e1e-7bb4-4491-b86f-e390b029b6e8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:38.187885 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-cd81faf9-9c72-4a57-820e-36ebd71f50bc req-7830cc47-106c-4c57-9d4d-d6939be32520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b781f2-0fd1-4873-9236-e01b979ce080", "name": "network-vif-plugged", "status": "completed", "tag": "fa40185e-3939-4e43-9d50-057280d094bd"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:57:38.198573 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-cd81faf9-9c72-4a57-820e-36ebd71f50bc req-7830cc47-106c-4c57-9d4d-d6939be32520 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:38.199849 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-cd81faf9-9c72-4a57-820e-36ebd71f50bc req-7830cc47-106c-4c57-9d4d-d6939be32520 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:38.215171 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-cd81faf9-9c72-4a57-820e-36ebd71f50bc req-7830cc47-106c-4c57-9d4d-d6939be32520 service nova] Creating event network-vif-plugged:fa40185e-3939-4e43-9d50-057280d094bd for instance 57b781f2-0fd1-4873-9236-e01b979ce080 on hv-cinder-82549 Jul 27 07:57:38.220111 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-cd81faf9-9c72-4a57-820e-36ebd71f50bc req-7830cc47-106c-4c57-9d4d-d6939be32520 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035761 Jul 27 07:57:38.221975 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 496/964] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:57:38.294573 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0b4b5e1e-7bb4-4491-b86f-e390b029b6e8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:38.303902 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0b4b5e1e-7bb4-4491-b86f-e390b029b6e8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 200 len: 1362 microversion: 2.1 time: 0.180319 Jul 27 07:57:38.304492 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 469/965] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:38 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:39.325312 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d9737744-a60c-49c9-9425-95e839a4e1f7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:39.326066 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d9737744-a60c-49c9-9425-95e839a4e1f7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:39.332277 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d9737744-a60c-49c9-9425-95e839a4e1f7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:39.333380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d9737744-a60c-49c9-9425-95e839a4e1f7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:39.334156 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d9737744-a60c-49c9-9425-95e839a4e1f7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:39.334597 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d9737744-a60c-49c9-9425-95e839a4e1f7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:39.465446 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d9737744-a60c-49c9-9425-95e839a4e1f7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:39.473214 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d9737744-a60c-49c9-9425-95e839a4e1f7 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 200 len: 1362 microversion: 2.1 time: 0.152771 Jul 27 07:57:39.473817 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 497/966] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:39 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:40.494076 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-81283851-3054-4a50-81b6-62b4795370ae tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:40.494679 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-81283851-3054-4a50-81b6-62b4795370ae tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:40.501757 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-81283851-3054-4a50-81b6-62b4795370ae tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:40.502215 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-81283851-3054-4a50-81b6-62b4795370ae tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:40.503016 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-81283851-3054-4a50-81b6-62b4795370ae tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:40.503560 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-81283851-3054-4a50-81b6-62b4795370ae tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:40.641817 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-81283851-3054-4a50-81b6-62b4795370ae tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:40.650229 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-81283851-3054-4a50-81b6-62b4795370ae tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 200 len: 1362 microversion: 2.1 time: 0.160381 Jul 27 07:57:40.650830 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 470/967] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:40 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:41.672136 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a895e8f1-7f2c-46a9-82bb-5b5343a40c3d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:41.672758 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a895e8f1-7f2c-46a9-82bb-5b5343a40c3d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:41.680202 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a895e8f1-7f2c-46a9-82bb-5b5343a40c3d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:41.680663 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a895e8f1-7f2c-46a9-82bb-5b5343a40c3d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:41.681447 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a895e8f1-7f2c-46a9-82bb-5b5343a40c3d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:41.681883 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a895e8f1-7f2c-46a9-82bb-5b5343a40c3d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:41.811063 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a895e8f1-7f2c-46a9-82bb-5b5343a40c3d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:41.819128 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a895e8f1-7f2c-46a9-82bb-5b5343a40c3d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 200 len: 1547 microversion: 2.1 time: 0.151002 Jul 27 07:57:41.819692 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 498/968] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:41 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:57:41.839648 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1ce53f52-f5c4-4e07-8fac-5d215e815fe1 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:41.840431 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1ce53f52-f5c4-4e07-8fac-5d215e815fe1 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:41.847336 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1ce53f52-f5c4-4e07-8fac-5d215e815fe1 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:41.847780 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1ce53f52-f5c4-4e07-8fac-5d215e815fe1 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:41.848581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1ce53f52-f5c4-4e07-8fac-5d215e815fe1 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:41.849012 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1ce53f52-f5c4-4e07-8fac-5d215e815fe1 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:41.931746 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1ce53f52-f5c4-4e07-8fac-5d215e815fe1 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095958 Jul 27 07:57:41.932288 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 471/969] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Jul 27 07:57:41 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:57:43.162544 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-48889dcf-0326-4901-b275-2eacc815d54f req-95247377-2026-4586-adf9-ea5ca81408f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57b781f2-0fd1-4873-9236-e01b979ce080", "tag": "fa40185e-3939-4e43-9d50-057280d094bd"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:57:43.175977 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-48889dcf-0326-4901-b275-2eacc815d54f req-95247377-2026-4586-adf9-ea5ca81408f3 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:43.176947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-48889dcf-0326-4901-b275-2eacc815d54f req-95247377-2026-4586-adf9-ea5ca81408f3 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:43.190501 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-48889dcf-0326-4901-b275-2eacc815d54f req-95247377-2026-4586-adf9-ea5ca81408f3 service nova] Creating event network-changed:fa40185e-3939-4e43-9d50-057280d094bd for instance 57b781f2-0fd1-4873-9236-e01b979ce080 on hv-cinder-82549 Jul 27 07:57:43.197358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-48889dcf-0326-4901-b275-2eacc815d54f req-95247377-2026-4586-adf9-ea5ca81408f3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042152 Jul 27 07:57:43.198295 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 499/970] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:57:54.558570 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=13 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:54.559347 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=73 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:54.563915 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e3f69116-422b-4d57-aee0-4d4564d64e0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:54.564401 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e3f69116-422b-4d57-aee0-4d4564d64e0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:54.572006 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e3f69116-422b-4d57-aee0-4d4564d64e0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:54.572448 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e3f69116-422b-4d57-aee0-4d4564d64e0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:54.573204 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e3f69116-422b-4d57-aee0-4d4564d64e0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:54.573633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e3f69116-422b-4d57-aee0-4d4564d64e0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:54.597119 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e3f69116-422b-4d57-aee0-4d4564d64e0a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f/ips" status: 200 len: 150 microversion: 2.1 time: 0.039747 Jul 27 07:57:54.597720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 472/971] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Jul 27 07:57:54 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:57:58.037268 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=11 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:58.038001 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=49 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:57:58.042783 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3815db2c-04ed-4bff-8b49-d7e288f262b6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63061c05-d1a3-4dc8-b6b2-c20cb5b4eff2"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:57:58.045238 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3815db2c-04ed-4bff-8b49-d7e288f262b6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:58.052183 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3815db2c-04ed-4bff-8b49-d7e288f262b6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:58.052635 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3815db2c-04ed-4bff-8b49-d7e288f262b6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:58.053396 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3815db2c-04ed-4bff-8b49-d7e288f262b6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:58.053835 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3815db2c-04ed-4bff-8b49-d7e288f262b6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:58.319597 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3815db2c-04ed-4bff-8b49-d7e288f262b6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "POST /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283599 Jul 27 07:57:58.320396 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 500/972] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Jul 27 07:57:58 2022] POST /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:57:59.377127 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0060b8bf-c9e4-425a-b9c0-955e1416bb2a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:57:59.377754 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0060b8bf-c9e4-425a-b9c0-955e1416bb2a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:59.384604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0060b8bf-c9e4-425a-b9c0-955e1416bb2a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:59.385048 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0060b8bf-c9e4-425a-b9c0-955e1416bb2a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:59.385808 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0060b8bf-c9e4-425a-b9c0-955e1416bb2a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:59.386238 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0060b8bf-c9e4-425a-b9c0-955e1416bb2a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:59.409091 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.objects.instance [None req-0060b8bf-c9e4-425a-b9c0-955e1416bb2a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lazy-loading 'flavor' on Instance uuid fb0b0841-bd90-4361-9866-e51a7c5db994 {{(pid=117779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:57:59.481534 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0060b8bf-c9e4-425a-b9c0-955e1416bb2a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "POST /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994/action" status: 202 len: 0 microversion: 2.1 time: 0.108053 Jul 27 07:57:59.482028 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 473/973] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Jul 27 07:57:59 2022] POST /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 07:57:59.490768 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-614dac55-3dda-4462-b55c-52da656c2edd tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:57:59.492028 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-614dac55-3dda-4462-b55c-52da656c2edd tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:57:59.498766 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-614dac55-3dda-4462-b55c-52da656c2edd tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:59.499263 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-614dac55-3dda-4462-b55c-52da656c2edd tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:59.500030 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-614dac55-3dda-4462-b55c-52da656c2edd tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:57:59.500469 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-614dac55-3dda-4462-b55c-52da656c2edd tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:57:59.635216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-614dac55-3dda-4462-b55c-52da656c2edd tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:57:59.642784 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-614dac55-3dda-4462-b55c-52da656c2edd tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.156175 Jul 27 07:57:59.643380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 501/974] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:57:59 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:00.665281 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-3a0bcdc9-9182-4ad0-9acb-0d5dd911ddf9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:00.665975 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-3a0bcdc9-9182-4ad0-9acb-0d5dd911ddf9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:00.672900 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3a0bcdc9-9182-4ad0-9acb-0d5dd911ddf9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:00.673348 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3a0bcdc9-9182-4ad0-9acb-0d5dd911ddf9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:00.674118 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3a0bcdc9-9182-4ad0-9acb-0d5dd911ddf9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:00.674737 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3a0bcdc9-9182-4ad0-9acb-0d5dd911ddf9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:00.812682 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3a0bcdc9-9182-4ad0-9acb-0d5dd911ddf9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:00.820403 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-3a0bcdc9-9182-4ad0-9acb-0d5dd911ddf9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.159962 Jul 27 07:58:00.821472 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 474/975] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:00 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:01.843509 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-399369db-d9b0-48be-bba5-d8a80cd68471 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:01.844130 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-399369db-d9b0-48be-bba5-d8a80cd68471 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:01.851111 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-399369db-d9b0-48be-bba5-d8a80cd68471 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:01.851552 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-399369db-d9b0-48be-bba5-d8a80cd68471 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:01.852994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-399369db-d9b0-48be-bba5-d8a80cd68471 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:01.853426 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-399369db-d9b0-48be-bba5-d8a80cd68471 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:01.989522 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-399369db-d9b0-48be-bba5-d8a80cd68471 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:01.998032 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-399369db-d9b0-48be-bba5-d8a80cd68471 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.158255 Jul 27 07:58:01.998571 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 502/976] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:01 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:03.021584 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-bf9d520f-5826-4ee3-8336-7d76d73680e9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:03.022139 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-bf9d520f-5826-4ee3-8336-7d76d73680e9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:03.028921 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bf9d520f-5826-4ee3-8336-7d76d73680e9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:03.029374 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bf9d520f-5826-4ee3-8336-7d76d73680e9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:03.030151 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bf9d520f-5826-4ee3-8336-7d76d73680e9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:03.030588 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bf9d520f-5826-4ee3-8336-7d76d73680e9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:03.166481 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-bf9d520f-5826-4ee3-8336-7d76d73680e9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:03.174064 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-bf9d520f-5826-4ee3-8336-7d76d73680e9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.156395 Jul 27 07:58:03.174634 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 475/977] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:03 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:04.195358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f782464e-bdf3-4c39-a376-03ee0877d67f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:04.196024 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f782464e-bdf3-4c39-a376-03ee0877d67f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:04.202556 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f782464e-bdf3-4c39-a376-03ee0877d67f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:04.203038 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f782464e-bdf3-4c39-a376-03ee0877d67f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:04.203794 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f782464e-bdf3-4c39-a376-03ee0877d67f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:04.204242 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f782464e-bdf3-4c39-a376-03ee0877d67f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:04.342075 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f782464e-bdf3-4c39-a376-03ee0877d67f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:04.349939 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f782464e-bdf3-4c39-a376-03ee0877d67f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.158491 Jul 27 07:58:04.350502 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 503/978] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:04 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:05.372690 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-39b47514-7dd4-4fae-be84-488ae81c3a0d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:05.373305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-39b47514-7dd4-4fae-be84-488ae81c3a0d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:05.380010 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-39b47514-7dd4-4fae-be84-488ae81c3a0d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:05.380458 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-39b47514-7dd4-4fae-be84-488ae81c3a0d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:05.381225 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-39b47514-7dd4-4fae-be84-488ae81c3a0d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:05.381659 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-39b47514-7dd4-4fae-be84-488ae81c3a0d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:05.517570 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-39b47514-7dd4-4fae-be84-488ae81c3a0d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:05.525795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-39b47514-7dd4-4fae-be84-488ae81c3a0d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.157000 Jul 27 07:58:05.526467 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 476/979] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:05 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:06.549073 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ce5a591c-2a7e-4dd8-8db2-5a37a63daa34 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:06.549690 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ce5a591c-2a7e-4dd8-8db2-5a37a63daa34 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:06.556257 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ce5a591c-2a7e-4dd8-8db2-5a37a63daa34 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:06.556706 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ce5a591c-2a7e-4dd8-8db2-5a37a63daa34 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:06.557471 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ce5a591c-2a7e-4dd8-8db2-5a37a63daa34 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:06.557905 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ce5a591c-2a7e-4dd8-8db2-5a37a63daa34 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:06.687210 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ce5a591c-2a7e-4dd8-8db2-5a37a63daa34 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:06.694667 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ce5a591c-2a7e-4dd8-8db2-5a37a63daa34 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.149617 Jul 27 07:58:06.695263 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 504/980] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:06 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:07.717491 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0a703893-9f21-4152-b840-6d37401c3a23 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:07.718786 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0a703893-9f21-4152-b840-6d37401c3a23 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:07.726060 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0a703893-9f21-4152-b840-6d37401c3a23 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:07.726597 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0a703893-9f21-4152-b840-6d37401c3a23 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:07.728130 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0a703893-9f21-4152-b840-6d37401c3a23 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:07.728638 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0a703893-9f21-4152-b840-6d37401c3a23 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:07.863274 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0a703893-9f21-4152-b840-6d37401c3a23 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:07.871374 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0a703893-9f21-4152-b840-6d37401c3a23 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.158002 Jul 27 07:58:07.871962 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 477/981] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:07 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:08.893760 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c7e88e2d-dad1-460d-92aa-9e88e2c4fc5e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:08.894536 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c7e88e2d-dad1-460d-92aa-9e88e2c4fc5e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:08.902027 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c7e88e2d-dad1-460d-92aa-9e88e2c4fc5e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:08.902559 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c7e88e2d-dad1-460d-92aa-9e88e2c4fc5e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:08.903439 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c7e88e2d-dad1-460d-92aa-9e88e2c4fc5e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:08.903952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c7e88e2d-dad1-460d-92aa-9e88e2c4fc5e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:09.043246 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c7e88e2d-dad1-460d-92aa-9e88e2c4fc5e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:09.051013 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c7e88e2d-dad1-460d-92aa-9e88e2c4fc5e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.161812 Jul 27 07:58:09.051592 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 505/982] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:08 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:10.072666 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0bbf5fa2-aecb-4e02-9285-d833d2474216 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:10.073269 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0bbf5fa2-aecb-4e02-9285-d833d2474216 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:10.079724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0bbf5fa2-aecb-4e02-9285-d833d2474216 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:10.080167 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0bbf5fa2-aecb-4e02-9285-d833d2474216 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:10.080929 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0bbf5fa2-aecb-4e02-9285-d833d2474216 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:10.081355 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0bbf5fa2-aecb-4e02-9285-d833d2474216 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:10.210568 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0bbf5fa2-aecb-4e02-9285-d833d2474216 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:10.218579 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0bbf5fa2-aecb-4e02-9285-d833d2474216 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.149693 Jul 27 07:58:10.219178 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 478/983] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:10 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:11.240542 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-67275c1e-0298-4880-8626-0c94d007b27b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:11.241131 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-67275c1e-0298-4880-8626-0c94d007b27b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:11.252500 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-67275c1e-0298-4880-8626-0c94d007b27b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:11.252940 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-67275c1e-0298-4880-8626-0c94d007b27b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:11.253723 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-67275c1e-0298-4880-8626-0c94d007b27b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:11.254365 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-67275c1e-0298-4880-8626-0c94d007b27b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:11.290832 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c919273b-04fb-4019-96a2-861dd607ebc7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63061c05-d1a3-4dc8-b6b2-c20cb5b4eff2"}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:58:11.293716 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c919273b-04fb-4019-96a2-861dd607ebc7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:11.300442 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c919273b-04fb-4019-96a2-861dd607ebc7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:11.300952 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c919273b-04fb-4019-96a2-861dd607ebc7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:11.301672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c919273b-04fb-4019-96a2-861dd607ebc7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:11.302108 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c919273b-04fb-4019-96a2-861dd607ebc7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:11.386184 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-c919273b-04fb-4019-96a2-861dd607ebc7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] HTTP exception thrown: Invalid volume: volume 63061c05-d1a3-4dc8-b6b2-c20cb5b4eff2 is already attached to instances: a66de7de-7505-4ee5-bf1f-ce3608663e6f Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c919273b-04fb-4019-96a2-861dd607ebc7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Request method failure captured: Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: POST /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f/os-volume_attachments HTTP/1.1 Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 74 Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O4dQ6_Byd_TD8xXq_XrmoAr0FnlxsHKbwgQB4VAdIj5jmoqqdcTwHdIHCz-P_Xc5D3ADlxoxXrDt03El4_T3pb-Ot48U5BPQM4YOeGwU-aBen5Ed5125zCHbhJWC6gPVYWV7POipX99mXjlK6dYXCdPUlOB_d-CTA6UDGcIc4XpxPg Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 07:58:11.387938 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 07:58:11.389587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:58:11.389587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 07:58:11.389587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 07:58:11.389587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 07:58:11.389587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 07:58:11.389587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 07:58:11.389587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 07:58:11.389587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: df8fb928aa42413b9d03e83f46dd48bc Jul 27 07:58:11.389587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 07:58:11.389587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Jul 27 07:58:11.389587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {"volumeAttachment": {"volumeId": "63061c05-d1a3-4dc8-b6b2-c20cb5b4eff2"}} Jul 27 07:58:11.389587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 07:58:11.390375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Invalid volume: volume 63061c05-d1a3-4dc8-b6b2-c20cb5b4eff2 is already attached to instances: a66de7de-7505-4ee5-bf1f-ce3608663e6f Jul 27 07:58:11.390375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'server_id': 'a66de7de-7505-4ee5-bf1f-ce3608663e6f', 'body': {'volumeAttachment': {'volumeId': '63061c05-d1a3-4dc8-b6b2-c20cb5b4eff2'}}} Jul 27 07:58:11.390375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:58:11.390375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:58:11.390375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 07:58:11.390375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 07:58:11.390375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 27 07:58:11.390375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 07:58:11.390375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 27 07:58:11.390375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 07:58:11.390375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 27 07:58:11.390375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 27 07:58:11.390375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 27 07:58:11.390375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 27 07:58:11.390375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 63061c05-d1a3-4dc8-b6b2-c20cb5b4eff2 is already attached to instances: a66de7de-7505-4ee5-bf1f-ce3608663e6f Jul 27 07:58:11.390375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:58:11.390375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:58:11.390375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:58:11.390375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 63061c05-d1a3-4dc8-b6b2-c20cb5b4eff2 is already attached to instances: a66de7de-7505-4ee5-bf1f-ce3608663e6f Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:58:11.391667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:58:11.392931 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:58:11.392931 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:58:11.392931 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:58:11.392931 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 63061c05-d1a3-4dc8-b6b2-c20cb5b4eff2 is already attached to instances: a66de7de-7505-4ee5-bf1f-ce3608663e6f Jul 27 07:58:11.392931 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:58:11.392931 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c919273b-04fb-4019-96a2-861dd607ebc7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Returning 400 to user: Invalid volume: volume 63061c05-d1a3-4dc8-b6b2-c20cb5b4eff2 is already attached to instances: a66de7de-7505-4ee5-bf1f-ce3608663e6f {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:58:11.392931 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c919273b-04fb-4019-96a2-861dd607ebc7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "POST /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103827 Jul 27 07:58:11.392931 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 479/984] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Jul 27 07:58:11 2022] POST /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 27 07:58:11.397361 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-67275c1e-0298-4880-8626-0c94d007b27b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:11.405185 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-67275c1e-0298-4880-8626-0c94d007b27b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.168580 Jul 27 07:58:11.405754 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 506/985] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:11 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:11.455987 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e5c3e8c7-5d00-4902-ba27-74721b83f2b9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:11.456485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e5c3e8c7-5d00-4902-ba27-74721b83f2b9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:11.463166 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e5c3e8c7-5d00-4902-ba27-74721b83f2b9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:11.463619 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e5c3e8c7-5d00-4902-ba27-74721b83f2b9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:11.464385 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e5c3e8c7-5d00-4902-ba27-74721b83f2b9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:11.464822 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e5c3e8c7-5d00-4902-ba27-74721b83f2b9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:11.545344 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.objects.instance [None req-e5c3e8c7-5d00-4902-ba27-74721b83f2b9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lazy-loading 'services' on Instance uuid a66de7de-7505-4ee5-bf1f-ce3608663e6f {{(pid=117779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:58:11.617940 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e5c3e8c7-5d00-4902-ba27-74721b83f2b9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f/os-volume_attachments/63061c05-d1a3-4dc8-b6b2-c20cb5b4eff2" status: 202 len: 0 microversion: 2.1 time: 0.165747 Jul 27 07:58:11.618530 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 480/986] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Jul 27 07:58:11 2022] DELETE /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f/os-volume_attachments/63061c05-d1a3-4dc8-b6b2-c20cb5b4eff2 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 07:58:11.626997 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-22159248-f6db-4370-add7-37945f6152a3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:11.629331 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-22159248-f6db-4370-add7-37945f6152a3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:11.639496 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-22159248-f6db-4370-add7-37945f6152a3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:11.640877 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-22159248-f6db-4370-add7-37945f6152a3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:11.641691 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-22159248-f6db-4370-add7-37945f6152a3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:11.642134 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-22159248-f6db-4370-add7-37945f6152a3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:11.673389 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-22159248-f6db-4370-add7-37945f6152a3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050298 Jul 27 07:58:11.673947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 507/987] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:58:11 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:58:12.427871 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0539638c-9f9c-421a-afe0-ca9b0236b9bd tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:12.428478 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0539638c-9f9c-421a-afe0-ca9b0236b9bd tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:12.435387 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0539638c-9f9c-421a-afe0-ca9b0236b9bd tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:12.435827 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0539638c-9f9c-421a-afe0-ca9b0236b9bd tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:12.436582 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0539638c-9f9c-421a-afe0-ca9b0236b9bd tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:12.437014 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0539638c-9f9c-421a-afe0-ca9b0236b9bd tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:12.575000 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0539638c-9f9c-421a-afe0-ca9b0236b9bd tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:12.582508 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0539638c-9f9c-421a-afe0-ca9b0236b9bd tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.159401 Jul 27 07:58:12.583092 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 481/988] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:12 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:12.687061 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-234434ea-558c-46b8-94af-a3b6446e5841 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:12.689152 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-234434ea-558c-46b8-94af-a3b6446e5841 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:12.695825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-234434ea-558c-46b8-94af-a3b6446e5841 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:12.696269 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-234434ea-558c-46b8-94af-a3b6446e5841 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:12.697036 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-234434ea-558c-46b8-94af-a3b6446e5841 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:12.697473 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-234434ea-558c-46b8-94af-a3b6446e5841 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:12.727201 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-234434ea-558c-46b8-94af-a3b6446e5841 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Jul 27 07:58:12.727768 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 508/989] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:58:12 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:58:13.604623 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-90bccd6f-6831-42ab-8df1-15663acd41d8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:13.605296 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-90bccd6f-6831-42ab-8df1-15663acd41d8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:13.611757 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-90bccd6f-6831-42ab-8df1-15663acd41d8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:13.612207 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-90bccd6f-6831-42ab-8df1-15663acd41d8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:13.612990 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-90bccd6f-6831-42ab-8df1-15663acd41d8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:13.613428 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-90bccd6f-6831-42ab-8df1-15663acd41d8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:13.743668 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6a2d34fe-0570-4579-93fe-9aebd5f8313b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:13.745754 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6a2d34fe-0570-4579-93fe-9aebd5f8313b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:13.746179 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-90bccd6f-6831-42ab-8df1-15663acd41d8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:13.752424 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6a2d34fe-0570-4579-93fe-9aebd5f8313b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:13.752871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6a2d34fe-0570-4579-93fe-9aebd5f8313b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:13.753647 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6a2d34fe-0570-4579-93fe-9aebd5f8313b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:13.753992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-90bccd6f-6831-42ab-8df1-15663acd41d8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.153776 Jul 27 07:58:13.754098 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6a2d34fe-0570-4579-93fe-9aebd5f8313b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:13.754562 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 482/990] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:13 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:58:13.783324 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6a2d34fe-0570-4579-93fe-9aebd5f8313b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043689 Jul 27 07:58:13.783881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 509/991] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:58:13 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:58:14.776214 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-01f1fa0c-882f-4511-9e41-75d2047b7030 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:14.776753 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-01f1fa0c-882f-4511-9e41-75d2047b7030 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:14.783364 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-01f1fa0c-882f-4511-9e41-75d2047b7030 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:14.783808 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-01f1fa0c-882f-4511-9e41-75d2047b7030 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:14.784662 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-01f1fa0c-882f-4511-9e41-75d2047b7030 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:14.785114 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-01f1fa0c-882f-4511-9e41-75d2047b7030 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:14.796022 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2f813bf1-fa16-4c0d-a987-0341a7fe23fb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:14.798176 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2f813bf1-fa16-4c0d-a987-0341a7fe23fb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:14.804682 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2f813bf1-fa16-4c0d-a987-0341a7fe23fb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:14.805126 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2f813bf1-fa16-4c0d-a987-0341a7fe23fb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:14.805891 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2f813bf1-fa16-4c0d-a987-0341a7fe23fb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:14.806323 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2f813bf1-fa16-4c0d-a987-0341a7fe23fb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:14.835010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2f813bf1-fa16-4c0d-a987-0341a7fe23fb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042712 Jul 27 07:58:14.835578 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 510/992] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:58:14 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 07:58:14.900026 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-20d00f61-fe88-4764-8648-febf8c7eb0a4 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:14.900518 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-20d00f61-fe88-4764-8648-febf8c7eb0a4 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:14.906237 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-20d00f61-fe88-4764-8648-febf8c7eb0a4 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:14.906686 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-20d00f61-fe88-4764-8648-febf8c7eb0a4 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:14.907502 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-20d00f61-fe88-4764-8648-febf8c7eb0a4 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:14.907938 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-20d00f61-fe88-4764-8648-febf8c7eb0a4 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:14.929464 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-01f1fa0c-882f-4511-9e41-75d2047b7030 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:14.932745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-20d00f61-fe88-4764-8648-febf8c7eb0a4 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 07:58:14.937115 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-01f1fa0c-882f-4511-9e41-75d2047b7030 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.165267 Jul 27 07:58:14.937775 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 483/993] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:14 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:15.010177 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-20d00f61-fe88-4764-8648-febf8c7eb0a4 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 204 len: 0 microversion: 2.1 time: 0.113739 Jul 27 07:58:15.010906 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 511/994] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 07:58:14 2022] DELETE /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 07:58:15.019596 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-cf2a3543-39e9-4b7f-9ccb-392aebb5bc98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:15.020300 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-cf2a3543-39e9-4b7f-9ccb-392aebb5bc98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:15.027161 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cf2a3543-39e9-4b7f-9ccb-392aebb5bc98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:15.027586 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cf2a3543-39e9-4b7f-9ccb-392aebb5bc98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:15.028794 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cf2a3543-39e9-4b7f-9ccb-392aebb5bc98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:15.029220 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-cf2a3543-39e9-4b7f-9ccb-392aebb5bc98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:15.306618 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-cf2a3543-39e9-4b7f-9ccb-392aebb5bc98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:15.314095 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-cf2a3543-39e9-4b7f-9ccb-392aebb5bc98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 200 len: 1681 microversion: 2.1 time: 0.298414 Jul 27 07:58:15.314651 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 484/995] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:15 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 1681 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:15.958725 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-03dd550f-1206-418a-9375-e8aaa8d1648a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:15.959470 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-03dd550f-1206-418a-9375-e8aaa8d1648a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:15.966738 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-03dd550f-1206-418a-9375-e8aaa8d1648a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:15.967244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-03dd550f-1206-418a-9375-e8aaa8d1648a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:15.968087 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-03dd550f-1206-418a-9375-e8aaa8d1648a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:15.968545 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-03dd550f-1206-418a-9375-e8aaa8d1648a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:16.114212 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-03dd550f-1206-418a-9375-e8aaa8d1648a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:16.124443 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-03dd550f-1206-418a-9375-e8aaa8d1648a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.169813 Jul 27 07:58:16.125625 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 512/996] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:15 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:16.335809 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-0206ac27-9b85-471d-b444-42a8928c3b67 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:16.336411 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-0206ac27-9b85-471d-b444-42a8928c3b67 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:16.343077 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0206ac27-9b85-471d-b444-42a8928c3b67 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:16.343514 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0206ac27-9b85-471d-b444-42a8928c3b67 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:16.344269 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0206ac27-9b85-471d-b444-42a8928c3b67 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:16.344694 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-0206ac27-9b85-471d-b444-42a8928c3b67 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:16.473945 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-0206ac27-9b85-471d-b444-42a8928c3b67 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:16.482027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-0206ac27-9b85-471d-b444-42a8928c3b67 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 200 len: 1681 microversion: 2.1 time: 0.150079 Jul 27 07:58:16.482581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 485/997] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:16 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:17.151802 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a7283303-32b9-4e4c-84e5-1735fcf6d7c9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:17.152853 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a7283303-32b9-4e4c-84e5-1735fcf6d7c9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:17.159992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a7283303-32b9-4e4c-84e5-1735fcf6d7c9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:17.160447 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a7283303-32b9-4e4c-84e5-1735fcf6d7c9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:17.161220 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a7283303-32b9-4e4c-84e5-1735fcf6d7c9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:17.161665 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a7283303-32b9-4e4c-84e5-1735fcf6d7c9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:17.179705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:17.382192 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a7283303-32b9-4e4c-84e5-1735fcf6d7c9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:17.391607 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a7283303-32b9-4e4c-84e5-1735fcf6d7c9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.247183 Jul 27 07:58:17.397535 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 513/998] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:17 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:17.503359 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7617d6c5-f51e-4d61-bd97-f6e24869ac11 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:17.504105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-7617d6c5-f51e-4d61-bd97-f6e24869ac11 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:17.511169 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7617d6c5-f51e-4d61-bd97-f6e24869ac11 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:17.511852 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7617d6c5-f51e-4d61-bd97-f6e24869ac11 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:17.512633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7617d6c5-f51e-4d61-bd97-f6e24869ac11 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:17.513243 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7617d6c5-f51e-4d61-bd97-f6e24869ac11 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:17.517529 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:17.671709 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7617d6c5-f51e-4d61-bd97-f6e24869ac11 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:17.680636 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7617d6c5-f51e-4d61-bd97-f6e24869ac11 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 200 len: 1681 microversion: 2.1 time: 0.181018 Jul 27 07:58:17.681331 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 486/999] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:17 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:18.184183 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-bf8c39b6-30a7-400e-9e95-bcfe67fbf3b4 req-2e8ac7a4-ead6-46ca-80db-89f885643ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66de7de-7505-4ee5-bf1f-ce3608663e6f", "name": "network-vif-deleted", "tag": "32407fa9-c995-4bfe-b8d6-9beb17542453"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:58:18.197191 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-bf8c39b6-30a7-400e-9e95-bcfe67fbf3b4 req-2e8ac7a4-ead6-46ca-80db-89f885643ad6 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:18.197639 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-bf8c39b6-30a7-400e-9e95-bcfe67fbf3b4 req-2e8ac7a4-ead6-46ca-80db-89f885643ad6 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:18.211686 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-bf8c39b6-30a7-400e-9e95-bcfe67fbf3b4 req-2e8ac7a4-ead6-46ca-80db-89f885643ad6 service nova] Creating event network-vif-deleted:32407fa9-c995-4bfe-b8d6-9beb17542453 for instance a66de7de-7505-4ee5-bf1f-ce3608663e6f on hv-cinder-82549 Jul 27 07:58:18.223353 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-bf8c39b6-30a7-400e-9e95-bcfe67fbf3b4 req-2e8ac7a4-ead6-46ca-80db-89f885643ad6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043775 Jul 27 07:58:18.224552 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 514/1000] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:58:18.415707 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c93fece0-669c-4413-9d7d-015399a92ed5 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:18.435540 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c93fece0-669c-4413-9d7d-015399a92ed5 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:18.454558 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c93fece0-669c-4413-9d7d-015399a92ed5 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:18.459919 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c93fece0-669c-4413-9d7d-015399a92ed5 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:18.463636 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c93fece0-669c-4413-9d7d-015399a92ed5 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:18.465263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c93fece0-669c-4413-9d7d-015399a92ed5 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:18.703679 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-69d26182-dd4a-4a3a-a6c6-89aee72eb076 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:18.704747 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-69d26182-dd4a-4a3a-a6c6-89aee72eb076 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:18.715074 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c93fece0-669c-4413-9d7d-015399a92ed5 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:18.725098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c93fece0-669c-4413-9d7d-015399a92ed5 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.315053 Jul 27 07:58:18.727561 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-69d26182-dd4a-4a3a-a6c6-89aee72eb076 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:18.731148 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 487/1001] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:18 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:18.732177 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-69d26182-dd4a-4a3a-a6c6-89aee72eb076 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:18.733320 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-69d26182-dd4a-4a3a-a6c6-89aee72eb076 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:18.734461 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-69d26182-dd4a-4a3a-a6c6-89aee72eb076 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:18.774228 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-69d26182-dd4a-4a3a-a6c6-89aee72eb076 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:18.774787 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-69d26182-dd4a-4a3a-a6c6-89aee72eb076 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:18.775347 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-69d26182-dd4a-4a3a-a6c6-89aee72eb076 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lazy-loading 'fault' on Instance uuid a66de7de-7505-4ee5-bf1f-ce3608663e6f {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:58:18.817970 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-69d26182-dd4a-4a3a-a6c6-89aee72eb076 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:18.826779 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-69d26182-dd4a-4a3a-a6c6-89aee72eb076 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 200 len: 1331 microversion: 2.1 time: 0.128056 Jul 27 07:58:18.828015 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 515/1002] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:18 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 1331 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:58:19.750646 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-68e14fce-c160-4862-acc3-e4651fed7f87 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:19.752091 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-68e14fce-c160-4862-acc3-e4651fed7f87 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:19.758873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-68e14fce-c160-4862-acc3-e4651fed7f87 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:19.759352 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-68e14fce-c160-4862-acc3-e4651fed7f87 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:19.760140 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-68e14fce-c160-4862-acc3-e4651fed7f87 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:19.760760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-68e14fce-c160-4862-acc3-e4651fed7f87 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:19.850038 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4c858e9c-5a58-42b4-934a-5209c006e47b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:19.850653 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4c858e9c-5a58-42b4-934a-5209c006e47b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:19.858254 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4c858e9c-5a58-42b4-934a-5209c006e47b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:19.858803 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4c858e9c-5a58-42b4-934a-5209c006e47b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:19.859902 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4c858e9c-5a58-42b4-934a-5209c006e47b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:19.860451 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4c858e9c-5a58-42b4-934a-5209c006e47b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:19.874861 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-4c858e9c-5a58-42b4-934a-5209c006e47b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] HTTP exception thrown: Instance a66de7de-7505-4ee5-bf1f-ce3608663e6f could not be found. Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4c858e9c-5a58-42b4-934a-5209c006e47b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Request method failure captured: Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f HTTP/1.1 Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O4dQ6_Byd_TD8xXq_XrmoAr0FnlxsHKbwgQB4VAdIj5jmoqqdcTwHdIHCz-P_Xc5D3ADlxoxXrDt03El4_T3pb-Ot48U5BPQM4YOeGwU-aBen5Ed5125zCHbhJWC6gPVYWV7POipX99mXjlK6dYXCdPUlOB_d-CTA6UDGcIc4XpxPg Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 07:58:19.877217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 07:58:19.878706 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:58:19.878706 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 07:58:19.878706 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 07:58:19.878706 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 07:58:19.878706 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 07:58:19.878706 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 07:58:19.878706 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 07:58:19.878706 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: df8fb928aa42413b9d03e83f46dd48bc Jul 27 07:58:19.878706 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 07:58:19.878706 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 07:58:19.878706 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance a66de7de-7505-4ee5-bf1f-ce3608663e6f could not be found. Jul 27 07:58:19.878706 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': 'a66de7de-7505-4ee5-bf1f-ce3608663e6f'} Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a66de7de-7505-4ee5-bf1f-ce3608663e6f could not be found. Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:58:19.880294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:58:19.881994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:58:19.881994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 07:58:19.881994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 07:58:19.881994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 07:58:19.881994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 07:58:19.881994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 07:58:19.881994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:58:19.881994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a66de7de-7505-4ee5-bf1f-ce3608663e6f could not be found. Jul 27 07:58:19.881994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:58:19.881994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:58:19.881994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:58:19.881994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:58:19.881994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:58:19.881994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:58:19.881994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:58:19.881994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:58:19.881994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a66de7de-7505-4ee5-bf1f-ce3608663e6f could not be found. Jul 27 07:58:19.881994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 07:58:19.883732 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4c858e9c-5a58-42b4-934a-5209c006e47b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Returning 404 to user: Instance a66de7de-7505-4ee5-bf1f-ce3608663e6f could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:58:19.883732 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4c858e9c-5a58-42b4-934a-5209c006e47b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 404 len: 111 microversion: 2.1 time: 0.036478 Jul 27 07:58:19.884485 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 516/1003] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:19 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 07:58:19.893849 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ecc60d98-76f3-4f3e-a8e9-a6e2a0c11536 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '.version_select at 0x7f19fe512820>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:19.915692 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ecc60d98-76f3-4f3e-a8e9-a6e2a0c11536 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845839791" status: 202 len: 0 microversion: 2.1 time: 0.026160 Jul 27 07:58:19.916726 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 517/1004] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Jul 27 07:58:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845839791 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 07:58:19.921902 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-68e14fce-c160-4862-acc3-e4651fed7f87 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:19.930084 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-68e14fce-c160-4862-acc3-e4651fed7f87 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.183733 Jul 27 07:58:19.932914 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 488/1005] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:19 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:20.560202 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-780ecb83-978f-4406-9c95-7678895da829 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Action: 'create', calling method: .version_select at 0x7f19fe670820>, body: {"keypair": {"name": "tempest-keypair-1519444808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM6tulowWn0pADRnbL3Np+0MCImvJ6Wf8L0zthzdcsvXAC5ZiEanpHH5wYlj2koKiLqliGuw8lnKm9ljn++KJ+Liqdu+R1HGDj05TNxMYsh5AwGZqDoNbHXHVDkJMtfiA=="}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:58:20.576922 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-780ecb83-978f-4406-9c95-7678895da829 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Getting quotas for project 1cabcb825ebe4430a7ffa759d5e53d2f. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:58:20.580919 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-780ecb83-978f-4406-9c95-7678895da829 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Getting quotas for user df8fb928aa42413b9d03e83f46dd48bc and project 1cabcb825ebe4430a7ffa759d5e53d2f. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:58:20.604684 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-780ecb83-978f-4406-9c95-7678895da829 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048370 Jul 27 07:58:20.605512 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 518/1006] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Jul 27 07:58:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:58:20.951723 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a78089a0-9f6e-45b9-bc7c-70233438a6f2 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:20.952441 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a78089a0-9f6e-45b9-bc7c-70233438a6f2 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:20.959500 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a78089a0-9f6e-45b9-bc7c-70233438a6f2 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:20.960045 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a78089a0-9f6e-45b9-bc7c-70233438a6f2 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:20.961134 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a78089a0-9f6e-45b9-bc7c-70233438a6f2 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:20.961744 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a78089a0-9f6e-45b9-bc7c-70233438a6f2 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:21.104272 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a78089a0-9f6e-45b9-bc7c-70233438a6f2 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:21.112819 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a78089a0-9f6e-45b9-bc7c-70233438a6f2 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.164922 Jul 27 07:58:21.113393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 489/1007] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:20 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:21.958055 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-acaff2f0-9dcc-479e-ad29-a95d2d1f4e2e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-766609027", "imageRef": "646bfb5d-ef25-404a-a432-35d4209840fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2524cead-0094-4b3d-89eb-61da848d7e54"}], "security_groups": [{"name": "tempest-securitygroup--971733025"}], "key_name": "tempest-keypair-1519444808", "user_data": "}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:58:22.112666 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.network.neutron [None req-acaff2f0-9dcc-479e-ad29-a95d2d1f4e2e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] validate_networks() for [('2524cead-0094-4b3d-89eb-61da848d7e54', None, None, None, None, None)] {{(pid=117780) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:58:22.135692 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-18041c70-3dc0-4c9d-b1da-97f913cc7ed4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:22.136620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-18041c70-3dc0-4c9d-b1da-97f913cc7ed4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:22.143389 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-18041c70-3dc0-4c9d-b1da-97f913cc7ed4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:22.143834 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-18041c70-3dc0-4c9d-b1da-97f913cc7ed4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:22.144607 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-18041c70-3dc0-4c9d-b1da-97f913cc7ed4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:22.145061 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-18041c70-3dc0-4c9d-b1da-97f913cc7ed4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:22.297024 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-18041c70-3dc0-4c9d-b1da-97f913cc7ed4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:22.305103 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-18041c70-3dc0-4c9d-b1da-97f913cc7ed4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1567 microversion: 2.1 time: 0.173717 Jul 27 07:58:22.305690 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 490/1008] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:22 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:58:22.325435 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ae300b15-6bc0-4343-80a8-fb35cf9bacf8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:58:22.325920 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ae300b15-6bc0-4343-80a8-fb35cf9bacf8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:22.331936 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ae300b15-6bc0-4343-80a8-fb35cf9bacf8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:22.332377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ae300b15-6bc0-4343-80a8-fb35cf9bacf8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:22.333140 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ae300b15-6bc0-4343-80a8-fb35cf9bacf8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:22.333569 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ae300b15-6bc0-4343-80a8-fb35cf9bacf8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:22.416622 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ae300b15-6bc0-4343-80a8-fb35cf9bacf8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "POST /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994/action" status: 202 len: 0 microversion: 2.1 time: 0.094995 Jul 27 07:58:22.417511 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 491/1009] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Jul 27 07:58:22 2022] POST /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 07:58:22.425791 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-61597261-5ca5-4c31-aea6-6305d34e6fc8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:22.426473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-61597261-5ca5-4c31-aea6-6305d34e6fc8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:22.434874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-61597261-5ca5-4c31-aea6-6305d34e6fc8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:22.435707 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-61597261-5ca5-4c31-aea6-6305d34e6fc8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:22.436397 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-61597261-5ca5-4c31-aea6-6305d34e6fc8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:22.436754 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-61597261-5ca5-4c31-aea6-6305d34e6fc8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:22.534604 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-acaff2f0-9dcc-479e-ad29-a95d2d1f4e2e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Flavor limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:58:22.535310 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-acaff2f0-9dcc-479e-ad29-a95d2d1f4e2e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Image limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:58:22.535791 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-acaff2f0-9dcc-479e-ad29-a95d2d1f4e2e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Flavor pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:58:22.536205 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-acaff2f0-9dcc-479e-ad29-a95d2d1f4e2e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Image pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:58:22.536715 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-acaff2f0-9dcc-479e-ad29-a95d2d1f4e2e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:58:22.549288 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-acaff2f0-9dcc-479e-ad29-a95d2d1f4e2e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:22.549886 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-acaff2f0-9dcc-479e-ad29-a95d2d1f4e2e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:22.550780 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-acaff2f0-9dcc-479e-ad29-a95d2d1f4e2e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:22.551329 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-acaff2f0-9dcc-479e-ad29-a95d2d1f4e2e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:22.569518 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-acaff2f0-9dcc-479e-ad29-a95d2d1f4e2e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Getting quotas for project 1cabcb825ebe4430a7ffa759d5e53d2f. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:58:22.574509 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-acaff2f0-9dcc-479e-ad29-a95d2d1f4e2e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Getting quotas for user df8fb928aa42413b9d03e83f46dd48bc and project 1cabcb825ebe4430a7ffa759d5e53d2f. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:58:22.588512 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-acaff2f0-9dcc-479e-ad29-a95d2d1f4e2e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Going to run 1 instances... {{(pid=117780) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:58:22.590828 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-acaff2f0-9dcc-479e-ad29-a95d2d1f4e2e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='646bfb5d-ef25-404a-a432-35d4209840fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:58:22.604902 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-61597261-5ca5-4c31-aea6-6305d34e6fc8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:22.614219 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-61597261-5ca5-4c31-aea6-6305d34e6fc8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1575 microversion: 2.1 time: 0.192212 Jul 27 07:58:22.615176 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 492/1010] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:22 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1575 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:22.638503 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-acaff2f0-9dcc-479e-ad29-a95d2d1f4e2e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.685458 Jul 27 07:58:22.639677 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 519/1011] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 07:58:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 07:58:22.651084 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c2f8b4bf-22e6-4588-a68c-bb69e0c1edd3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:22.651856 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c2f8b4bf-22e6-4588-a68c-bb69e0c1edd3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:22.713827 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c2f8b4bf-22e6-4588-a68c-bb69e0c1edd3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:22.721892 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c2f8b4bf-22e6-4588-a68c-bb69e0c1edd3 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1241 microversion: 2.1 time: 0.075211 Jul 27 07:58:22.722836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 493/1012] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:22 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:23.640845 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f86adf3c-1358-4a92-b8bc-1e508833166a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:23.641454 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f86adf3c-1358-4a92-b8bc-1e508833166a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:23.648605 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f86adf3c-1358-4a92-b8bc-1e508833166a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:23.649057 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f86adf3c-1358-4a92-b8bc-1e508833166a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:23.649823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f86adf3c-1358-4a92-b8bc-1e508833166a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:23.650258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f86adf3c-1358-4a92-b8bc-1e508833166a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:23.743687 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b571e652-8d26-4d2e-9b8a-848945aec527 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:23.744330 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b571e652-8d26-4d2e-9b8a-848945aec527 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:23.751587 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b571e652-8d26-4d2e-9b8a-848945aec527 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:23.752030 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b571e652-8d26-4d2e-9b8a-848945aec527 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:23.752797 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b571e652-8d26-4d2e-9b8a-848945aec527 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:23.753231 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b571e652-8d26-4d2e-9b8a-848945aec527 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:23.792175 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f86adf3c-1358-4a92-b8bc-1e508833166a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:23.799731 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f86adf3c-1358-4a92-b8bc-1e508833166a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1517 microversion: 2.1 time: 0.163076 Jul 27 07:58:23.800307 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 520/1013] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:23 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:23.817082 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b571e652-8d26-4d2e-9b8a-848945aec527 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:23.824488 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b571e652-8d26-4d2e-9b8a-848945aec527 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1245 microversion: 2.1 time: 0.084761 Jul 27 07:58:23.825036 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 494/1014] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:23 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:24.822278 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9db2c898-8a43-4c80-bfb6-662f777af082 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:24.822907 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9db2c898-8a43-4c80-bfb6-662f777af082 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:24.829405 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9db2c898-8a43-4c80-bfb6-662f777af082 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:24.829991 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9db2c898-8a43-4c80-bfb6-662f777af082 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:24.830597 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9db2c898-8a43-4c80-bfb6-662f777af082 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:24.831071 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9db2c898-8a43-4c80-bfb6-662f777af082 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:24.845360 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e065f23a-6d5c-439b-a4d4-4d2d69ecc824 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:24.845982 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e065f23a-6d5c-439b-a4d4-4d2d69ecc824 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:24.848738 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=51 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:24.854513 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e065f23a-6d5c-439b-a4d4-4d2d69ecc824 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:24.855016 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e065f23a-6d5c-439b-a4d4-4d2d69ecc824 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:24.855797 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e065f23a-6d5c-439b-a4d4-4d2d69ecc824 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:24.856237 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e065f23a-6d5c-439b-a4d4-4d2d69ecc824 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:24.921105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e065f23a-6d5c-439b-a4d4-4d2d69ecc824 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:24.928695 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e065f23a-6d5c-439b-a4d4-4d2d69ecc824 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1245 microversion: 2.1 time: 0.087157 Jul 27 07:58:24.930050 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 495/1015] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:24 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:58:24.966575 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9db2c898-8a43-4c80-bfb6-662f777af082 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:24.974451 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9db2c898-8a43-4c80-bfb6-662f777af082 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1517 microversion: 2.1 time: 0.156672 Jul 27 07:58:24.975035 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 521/1016] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:24 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:25.952172 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-230f1ed2-8da2-45b1-b86b-435d34efcad6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:25.952775 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-230f1ed2-8da2-45b1-b86b-435d34efcad6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:25.959354 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-230f1ed2-8da2-45b1-b86b-435d34efcad6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:25.959795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-230f1ed2-8da2-45b1-b86b-435d34efcad6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:25.961202 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-230f1ed2-8da2-45b1-b86b-435d34efcad6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:25.961549 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-230f1ed2-8da2-45b1-b86b-435d34efcad6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:25.996515 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1824d5a3-0508-4441-a76a-20c1e20c237d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:25.997136 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1824d5a3-0508-4441-a76a-20c1e20c237d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:26.004115 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1824d5a3-0508-4441-a76a-20c1e20c237d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:26.004567 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1824d5a3-0508-4441-a76a-20c1e20c237d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:26.005345 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1824d5a3-0508-4441-a76a-20c1e20c237d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:26.005780 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1824d5a3-0508-4441-a76a-20c1e20c237d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:26.021974 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-230f1ed2-8da2-45b1-b86b-435d34efcad6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:26.030350 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-230f1ed2-8da2-45b1-b86b-435d34efcad6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1245 microversion: 2.1 time: 0.081913 Jul 27 07:58:26.030964 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 496/1017] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:25 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:26.144750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1824d5a3-0508-4441-a76a-20c1e20c237d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:26.153952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1824d5a3-0508-4441-a76a-20c1e20c237d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1517 microversion: 2.1 time: 0.161167 Jul 27 07:58:26.154832 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 522/1018] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:25 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:58:26.308092 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-7be8f295-0536-412e-88e9-3e50a8867b92 req-ebddd596-2b9e-4f13-9ad9-2012686b5789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0b0841-bd90-4361-9866-e51a7c5db994", "name": "network-vif-unplugged", "status": "completed", "tag": "6eaca3f7-b87d-4766-ad60-73f678ccc493"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:58:26.321033 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-7be8f295-0536-412e-88e9-3e50a8867b92 req-ebddd596-2b9e-4f13-9ad9-2012686b5789 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:26.321536 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-7be8f295-0536-412e-88e9-3e50a8867b92 req-ebddd596-2b9e-4f13-9ad9-2012686b5789 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:26.333860 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.compute.server_external_events [req-7be8f295-0536-412e-88e9-3e50a8867b92 req-ebddd596-2b9e-4f13-9ad9-2012686b5789 service nova] Unable to find a host for instance fb0b0841-bd90-4361-9866-e51a7c5db994. Dropping event network-vif-unplugged {{(pid=117779) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 27 07:58:26.335087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-7be8f295-0536-412e-88e9-3e50a8867b92 req-ebddd596-2b9e-4f13-9ad9-2012686b5789 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031808 Jul 27 07:58:26.336383 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 497/1019] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 27 07:58:27.051473 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a5023b2e-7a42-43df-acf0-713f56c68aff tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:27.052093 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a5023b2e-7a42-43df-acf0-713f56c68aff tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:27.064477 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a5023b2e-7a42-43df-acf0-713f56c68aff tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:27.064937 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a5023b2e-7a42-43df-acf0-713f56c68aff tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:27.065742 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a5023b2e-7a42-43df-acf0-713f56c68aff tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:27.066185 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a5023b2e-7a42-43df-acf0-713f56c68aff tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:27.166466 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a5023b2e-7a42-43df-acf0-713f56c68aff tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:27.175299 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a5023b2e-7a42-43df-acf0-713f56c68aff tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1299 microversion: 2.1 time: 0.127498 Jul 27 07:58:27.176175 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 523/1020] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:27 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1299 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:27.177512 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-34bcf923-e780-48d6-94b3-2539428a00f1 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:27.178282 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-34bcf923-e780-48d6-94b3-2539428a00f1 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:27.186418 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-34bcf923-e780-48d6-94b3-2539428a00f1 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:27.187001 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-34bcf923-e780-48d6-94b3-2539428a00f1 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:27.187860 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-34bcf923-e780-48d6-94b3-2539428a00f1 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:27.188479 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-34bcf923-e780-48d6-94b3-2539428a00f1 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:27.366032 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-34bcf923-e780-48d6-94b3-2539428a00f1 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:27.375087 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-34bcf923-e780-48d6-94b3-2539428a00f1 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1517 microversion: 2.1 time: 0.203312 Jul 27 07:58:27.375660 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 498/1021] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:27 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1517 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:58:28.198013 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-67a4eeac-01d7-45ba-bbd0-c4c41a5995f7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:28.198636 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-67a4eeac-01d7-45ba-bbd0-c4c41a5995f7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:28.208226 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:28.211141 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-67a4eeac-01d7-45ba-bbd0-c4c41a5995f7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:28.211711 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-67a4eeac-01d7-45ba-bbd0-c4c41a5995f7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:28.212903 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-67a4eeac-01d7-45ba-bbd0-c4c41a5995f7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:28.213456 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-67a4eeac-01d7-45ba-bbd0-c4c41a5995f7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:28.396699 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-3725e894-49e2-4ede-96bb-353618264b0a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:28.397309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-3725e894-49e2-4ede-96bb-353618264b0a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:28.404503 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3725e894-49e2-4ede-96bb-353618264b0a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:28.404943 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3725e894-49e2-4ede-96bb-353618264b0a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:28.405712 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3725e894-49e2-4ede-96bb-353618264b0a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:28.406140 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3725e894-49e2-4ede-96bb-353618264b0a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:28.435145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-67a4eeac-01d7-45ba-bbd0-c4c41a5995f7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:28.445200 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-67a4eeac-01d7-45ba-bbd0-c4c41a5995f7 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1366 microversion: 2.1 time: 0.251526 Jul 27 07:58:28.446059 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 524/1022] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:28 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:28.568886 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3725e894-49e2-4ede-96bb-353618264b0a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:28.580852 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-3725e894-49e2-4ede-96bb-353618264b0a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1573 microversion: 2.1 time: 0.188206 Jul 27 07:58:28.581428 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 499/1023] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:28 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1573 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:58:28.705691 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-0cf26407-f39e-454a-9f6d-52f7f780eb5c req-f9480090-26e6-43c1-a41a-a78f4562e0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aea362c-4af7-4df2-ac79-952869e1d458", "tag": "856b98bd-bf18-4a03-969a-994a99cb10fe"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:58:28.716368 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-0cf26407-f39e-454a-9f6d-52f7f780eb5c req-f9480090-26e6-43c1-a41a-a78f4562e0c7 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:28.716933 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-0cf26407-f39e-454a-9f6d-52f7f780eb5c req-f9480090-26e6-43c1-a41a-a78f4562e0c7 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:28.732030 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-0cf26407-f39e-454a-9f6d-52f7f780eb5c req-f9480090-26e6-43c1-a41a-a78f4562e0c7 service nova] Creating event network-changed:856b98bd-bf18-4a03-969a-994a99cb10fe for instance 4aea362c-4af7-4df2-ac79-952869e1d458 on hv-cinder-82549 Jul 27 07:58:28.737834 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-0cf26407-f39e-454a-9f6d-52f7f780eb5c req-f9480090-26e6-43c1-a41a-a78f4562e0c7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036145 Jul 27 07:58:28.738634 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 525/1024] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:58:29.470067 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-868a513f-93be-4382-8fe9-eb0d117928fd tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:29.470918 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-868a513f-93be-4382-8fe9-eb0d117928fd tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:29.479398 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-868a513f-93be-4382-8fe9-eb0d117928fd tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:29.479857 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-868a513f-93be-4382-8fe9-eb0d117928fd tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:29.480637 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-868a513f-93be-4382-8fe9-eb0d117928fd tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:29.482956 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-868a513f-93be-4382-8fe9-eb0d117928fd tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:29.603147 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-14f99b01-f1db-4bf6-b118-d6690b3a0a91 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:29.604358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-14f99b01-f1db-4bf6-b118-d6690b3a0a91 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:29.611074 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14f99b01-f1db-4bf6-b118-d6690b3a0a91 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:29.611602 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14f99b01-f1db-4bf6-b118-d6690b3a0a91 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:29.612478 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14f99b01-f1db-4bf6-b118-d6690b3a0a91 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:29.612991 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14f99b01-f1db-4bf6-b118-d6690b3a0a91 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:29.638315 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-868a513f-93be-4382-8fe9-eb0d117928fd tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:29.647009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-868a513f-93be-4382-8fe9-eb0d117928fd tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1366 microversion: 2.1 time: 0.184537 Jul 27 07:58:29.647604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 500/1025] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:29 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:29.772413 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-14f99b01-f1db-4bf6-b118-d6690b3a0a91 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:29.780008 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-14f99b01-f1db-4bf6-b118-d6690b3a0a91 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1573 microversion: 2.1 time: 0.181791 Jul 27 07:58:29.780582 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 526/1026] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:29 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1573 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:58:30.667654 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-29b3dd6d-dc1c-4fae-b352-2d7243a5f3bf tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:30.668363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-29b3dd6d-dc1c-4fae-b352-2d7243a5f3bf tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:30.675888 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-29b3dd6d-dc1c-4fae-b352-2d7243a5f3bf tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:30.676378 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-29b3dd6d-dc1c-4fae-b352-2d7243a5f3bf tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:30.677172 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-29b3dd6d-dc1c-4fae-b352-2d7243a5f3bf tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:30.677631 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-29b3dd6d-dc1c-4fae-b352-2d7243a5f3bf tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:30.801032 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-39028ecd-2b79-4a58-bc3b-40aae8ed7277 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:30.801638 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-39028ecd-2b79-4a58-bc3b-40aae8ed7277 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:30.808819 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-39028ecd-2b79-4a58-bc3b-40aae8ed7277 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:30.809225 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-39028ecd-2b79-4a58-bc3b-40aae8ed7277 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:30.810108 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-39028ecd-2b79-4a58-bc3b-40aae8ed7277 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:30.810776 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-39028ecd-2b79-4a58-bc3b-40aae8ed7277 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:30.836321 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-29b3dd6d-dc1c-4fae-b352-2d7243a5f3bf tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:30.844458 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-29b3dd6d-dc1c-4fae-b352-2d7243a5f3bf tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1366 microversion: 2.1 time: 0.180453 Jul 27 07:58:30.845133 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 501/1027] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:30 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:30.951581 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-39028ecd-2b79-4a58-bc3b-40aae8ed7277 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:30.959122 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-39028ecd-2b79-4a58-bc3b-40aae8ed7277 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1573 microversion: 2.1 time: 0.162079 Jul 27 07:58:30.959828 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 527/1028] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:30 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:58:31.867721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-ecf2b748-c610-4e44-83eb-1501b441af0b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:31.868322 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-ecf2b748-c610-4e44-83eb-1501b441af0b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:31.875105 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ecf2b748-c610-4e44-83eb-1501b441af0b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:31.875554 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ecf2b748-c610-4e44-83eb-1501b441af0b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:31.876335 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ecf2b748-c610-4e44-83eb-1501b441af0b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:31.876762 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-ecf2b748-c610-4e44-83eb-1501b441af0b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:31.981969 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5087e334-9ae3-4b1c-b328-b0569bc434f4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:31.982648 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5087e334-9ae3-4b1c-b328-b0569bc434f4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:31.989378 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5087e334-9ae3-4b1c-b328-b0569bc434f4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:31.989910 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5087e334-9ae3-4b1c-b328-b0569bc434f4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:31.990755 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5087e334-9ae3-4b1c-b328-b0569bc434f4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:31.991351 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5087e334-9ae3-4b1c-b328-b0569bc434f4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:32.033652 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-ecf2b748-c610-4e44-83eb-1501b441af0b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:32.045421 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-ecf2b748-c610-4e44-83eb-1501b441af0b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1366 microversion: 2.1 time: 0.182487 Jul 27 07:58:32.046280 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 502/1029] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:31 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:32.137644 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5087e334-9ae3-4b1c-b328-b0569bc434f4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:32.145161 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5087e334-9ae3-4b1c-b328-b0569bc434f4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1573 microversion: 2.1 time: 0.167031 Jul 27 07:58:32.145731 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 528/1030] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:31 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:58:33.065926 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b484476f-755a-4386-88b0-17cfa5f9f421 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:33.066533 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b484476f-755a-4386-88b0-17cfa5f9f421 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:33.068501 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=2 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:33.074488 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b484476f-755a-4386-88b0-17cfa5f9f421 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:33.074955 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b484476f-755a-4386-88b0-17cfa5f9f421 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:33.075767 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b484476f-755a-4386-88b0-17cfa5f9f421 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:33.076171 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b484476f-755a-4386-88b0-17cfa5f9f421 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:33.095019 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:33.167934 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3cf3fc4b-4260-4168-bb78-e2a2f0414bb6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:33.168562 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3cf3fc4b-4260-4168-bb78-e2a2f0414bb6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:33.170769 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:33.172233 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=10 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:33.179995 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3cf3fc4b-4260-4168-bb78-e2a2f0414bb6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:33.180450 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3cf3fc4b-4260-4168-bb78-e2a2f0414bb6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:33.181268 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3cf3fc4b-4260-4168-bb78-e2a2f0414bb6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:33.181714 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3cf3fc4b-4260-4168-bb78-e2a2f0414bb6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:33.222988 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b484476f-755a-4386-88b0-17cfa5f9f421 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:33.231382 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b484476f-755a-4386-88b0-17cfa5f9f421 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1366 microversion: 2.1 time: 0.169130 Jul 27 07:58:33.231953 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 503/1031] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:33 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:33.321932 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3cf3fc4b-4260-4168-bb78-e2a2f0414bb6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:33.331209 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3cf3fc4b-4260-4168-bb78-e2a2f0414bb6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1573 microversion: 2.1 time: 0.167805 Jul 27 07:58:33.331980 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 529/1032] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:33 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:58:34.255787 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-fc885085-ec2e-435e-9285-e26e4ea579ba tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:34.257397 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-fc885085-ec2e-435e-9285-e26e4ea579ba tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:34.265206 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fc885085-ec2e-435e-9285-e26e4ea579ba tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:34.265772 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fc885085-ec2e-435e-9285-e26e4ea579ba tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:34.266646 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fc885085-ec2e-435e-9285-e26e4ea579ba tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:34.267220 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fc885085-ec2e-435e-9285-e26e4ea579ba tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:34.357933 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-52111568-1afc-4c07-a801-a6406154cdcf tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:34.359163 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-52111568-1afc-4c07-a801-a6406154cdcf tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:34.366021 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-52111568-1afc-4c07-a801-a6406154cdcf tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:34.367327 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-52111568-1afc-4c07-a801-a6406154cdcf tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:34.368212 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-52111568-1afc-4c07-a801-a6406154cdcf tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:34.368841 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-52111568-1afc-4c07-a801-a6406154cdcf tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:34.406461 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-fc885085-ec2e-435e-9285-e26e4ea579ba tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:34.415323 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-fc885085-ec2e-435e-9285-e26e4ea579ba tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1366 microversion: 2.1 time: 0.164641 Jul 27 07:58:34.416014 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 504/1033] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:34 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:34.517967 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-52111568-1afc-4c07-a801-a6406154cdcf tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:34.525754 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-52111568-1afc-4c07-a801-a6406154cdcf tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1573 microversion: 2.1 time: 0.175329 Jul 27 07:58:34.526339 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 530/1034] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:34 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:35.437161 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d53f279f-48c8-4549-8e93-18a82cc42e82 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:35.437777 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d53f279f-48c8-4549-8e93-18a82cc42e82 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:35.444437 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d53f279f-48c8-4549-8e93-18a82cc42e82 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:35.444882 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d53f279f-48c8-4549-8e93-18a82cc42e82 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:35.445644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d53f279f-48c8-4549-8e93-18a82cc42e82 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:35.446078 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d53f279f-48c8-4549-8e93-18a82cc42e82 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:35.547266 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0def7aab-4587-4efe-8371-a2ca16f4e1ed tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:35.548434 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0def7aab-4587-4efe-8371-a2ca16f4e1ed tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:35.556057 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0def7aab-4587-4efe-8371-a2ca16f4e1ed tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:35.556537 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0def7aab-4587-4efe-8371-a2ca16f4e1ed tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:35.557335 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0def7aab-4587-4efe-8371-a2ca16f4e1ed tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:35.557734 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0def7aab-4587-4efe-8371-a2ca16f4e1ed tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:35.584057 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d53f279f-48c8-4549-8e93-18a82cc42e82 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:35.592001 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d53f279f-48c8-4549-8e93-18a82cc42e82 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1366 microversion: 2.1 time: 0.159384 Jul 27 07:58:35.592567 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 505/1035] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:35 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:35.692436 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0def7aab-4587-4efe-8371-a2ca16f4e1ed tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:35.699985 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0def7aab-4587-4efe-8371-a2ca16f4e1ed tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1573 microversion: 2.1 time: 0.156507 Jul 27 07:58:35.700592 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 531/1036] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:35 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:58:36.441119 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-03c01639-3236-41f5-b17d-eaa4280b4f7b req-63497258-1296-4d0f-9134-7e899037556c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aea362c-4af7-4df2-ac79-952869e1d458", "name": "network-vif-plugged", "status": "completed", "tag": "856b98bd-bf18-4a03-969a-994a99cb10fe"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:58:36.452314 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-03c01639-3236-41f5-b17d-eaa4280b4f7b req-63497258-1296-4d0f-9134-7e899037556c service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:36.453027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-03c01639-3236-41f5-b17d-eaa4280b4f7b req-63497258-1296-4d0f-9134-7e899037556c service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:36.465833 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-03c01639-3236-41f5-b17d-eaa4280b4f7b req-63497258-1296-4d0f-9134-7e899037556c service nova] Creating event network-vif-plugged:856b98bd-bf18-4a03-969a-994a99cb10fe for instance 4aea362c-4af7-4df2-ac79-952869e1d458 on hv-cinder-82549 Jul 27 07:58:36.470933 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-03c01639-3236-41f5-b17d-eaa4280b4f7b req-63497258-1296-4d0f-9134-7e899037556c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033350 Jul 27 07:58:36.471980 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 506/1037] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:58:36.614784 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5f9f7e3f-dff9-4be7-8b05-55b8937aff82 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:36.615941 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5f9f7e3f-dff9-4be7-8b05-55b8937aff82 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:36.625028 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5f9f7e3f-dff9-4be7-8b05-55b8937aff82 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:36.625648 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5f9f7e3f-dff9-4be7-8b05-55b8937aff82 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:36.626701 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5f9f7e3f-dff9-4be7-8b05-55b8937aff82 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:36.627287 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5f9f7e3f-dff9-4be7-8b05-55b8937aff82 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:36.722064 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-813880f2-61a1-4264-bec5-3c196633e55f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:36.723023 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-813880f2-61a1-4264-bec5-3c196633e55f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:36.729541 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-813880f2-61a1-4264-bec5-3c196633e55f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:36.729985 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-813880f2-61a1-4264-bec5-3c196633e55f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:36.730760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-813880f2-61a1-4264-bec5-3c196633e55f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:36.731223 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-813880f2-61a1-4264-bec5-3c196633e55f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:36.774063 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5f9f7e3f-dff9-4be7-8b05-55b8937aff82 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:36.792577 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5f9f7e3f-dff9-4be7-8b05-55b8937aff82 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1366 microversion: 2.1 time: 0.182777 Jul 27 07:58:36.793162 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 532/1038] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:36 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:36.955241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-813880f2-61a1-4264-bec5-3c196633e55f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:36.969069 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-813880f2-61a1-4264-bec5-3c196633e55f tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1573 microversion: 2.1 time: 0.250451 Jul 27 07:58:36.977783 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 507/1039] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:36 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1573 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:58:37.813577 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d976c605-5688-4c1f-b254-55e7b4062e5a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:37.814362 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d976c605-5688-4c1f-b254-55e7b4062e5a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:37.820897 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d976c605-5688-4c1f-b254-55e7b4062e5a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:37.821344 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d976c605-5688-4c1f-b254-55e7b4062e5a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:37.822103 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d976c605-5688-4c1f-b254-55e7b4062e5a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:37.822532 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d976c605-5688-4c1f-b254-55e7b4062e5a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:37.966916 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d976c605-5688-4c1f-b254-55e7b4062e5a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:37.974553 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d976c605-5688-4c1f-b254-55e7b4062e5a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1366 microversion: 2.1 time: 0.164866 Jul 27 07:58:37.975163 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 533/1040] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:37 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:37.991628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-af22261d-14d1-4c76-9cff-53096d58a480 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:37.992239 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-af22261d-14d1-4c76-9cff-53096d58a480 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:37.998804 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-af22261d-14d1-4c76-9cff-53096d58a480 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:37.999313 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-af22261d-14d1-4c76-9cff-53096d58a480 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:38.000130 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-af22261d-14d1-4c76-9cff-53096d58a480 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:38.000564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-af22261d-14d1-4c76-9cff-53096d58a480 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:38.163328 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-af22261d-14d1-4c76-9cff-53096d58a480 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:38.173233 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-af22261d-14d1-4c76-9cff-53096d58a480 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1573 microversion: 2.1 time: 0.185656 Jul 27 07:58:38.173982 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 508/1041] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:37 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1573 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:38.996538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c1fd3f3a-91d4-4bb8-a39c-f41c8a09089a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:38.997864 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c1fd3f3a-91d4-4bb8-a39c-f41c8a09089a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:39.004549 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c1fd3f3a-91d4-4bb8-a39c-f41c8a09089a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:39.005084 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c1fd3f3a-91d4-4bb8-a39c-f41c8a09089a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:39.005930 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c1fd3f3a-91d4-4bb8-a39c-f41c8a09089a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:39.006634 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c1fd3f3a-91d4-4bb8-a39c-f41c8a09089a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:39.024813 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:39.170786 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c1fd3f3a-91d4-4bb8-a39c-f41c8a09089a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:39.180357 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c1fd3f3a-91d4-4bb8-a39c-f41c8a09089a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1366 microversion: 2.1 time: 0.187457 Jul 27 07:58:39.181151 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 534/1042] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:38 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:39.197572 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1966fea0-3663-4ddc-93fc-95e868c4e0d7 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:39.198370 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1966fea0-3663-4ddc-93fc-95e868c4e0d7 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:39.222114 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1966fea0-3663-4ddc-93fc-95e868c4e0d7 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:39.222686 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1966fea0-3663-4ddc-93fc-95e868c4e0d7 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:39.223746 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1966fea0-3663-4ddc-93fc-95e868c4e0d7 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:39.224418 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1966fea0-3663-4ddc-93fc-95e868c4e0d7 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:39.377513 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1966fea0-3663-4ddc-93fc-95e868c4e0d7 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:39.385229 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1966fea0-3663-4ddc-93fc-95e868c4e0d7 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1573 microversion: 2.1 time: 0.191471 Jul 27 07:58:39.385798 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 509/1043] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:39 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1573 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:40.201160 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b37acddb-1a41-48e3-9abc-5067184eb9d0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:40.201731 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b37acddb-1a41-48e3-9abc-5067184eb9d0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:40.208524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b37acddb-1a41-48e3-9abc-5067184eb9d0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:40.209041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b37acddb-1a41-48e3-9abc-5067184eb9d0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:40.209871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b37acddb-1a41-48e3-9abc-5067184eb9d0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:40.210303 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b37acddb-1a41-48e3-9abc-5067184eb9d0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:40.350809 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b37acddb-1a41-48e3-9abc-5067184eb9d0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:40.359131 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b37acddb-1a41-48e3-9abc-5067184eb9d0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1556 microversion: 2.1 time: 0.161550 Jul 27 07:58:40.359724 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 535/1044] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:40 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:40.380130 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c364333a-0308-4cdf-8bed-94924ee75975 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:40.380655 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c364333a-0308-4cdf-8bed-94924ee75975 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:40.387197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c364333a-0308-4cdf-8bed-94924ee75975 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:40.387644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c364333a-0308-4cdf-8bed-94924ee75975 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:40.389168 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c364333a-0308-4cdf-8bed-94924ee75975 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:40.389168 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c364333a-0308-4cdf-8bed-94924ee75975 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:40.407351 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-045bf0ce-beb9-4113-a4fa-ee4ce600efc4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:40.408117 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-045bf0ce-beb9-4113-a4fa-ee4ce600efc4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:40.415449 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-045bf0ce-beb9-4113-a4fa-ee4ce600efc4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:40.416171 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-045bf0ce-beb9-4113-a4fa-ee4ce600efc4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:40.417122 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-045bf0ce-beb9-4113-a4fa-ee4ce600efc4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:40.417850 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-045bf0ce-beb9-4113-a4fa-ee4ce600efc4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:40.508487 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c364333a-0308-4cdf-8bed-94924ee75975 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131961 Jul 27 07:58:40.510654 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 510/1045] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Jul 27 07:58:40 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:58:40.517298 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-eda4e6a8-9b8a-4d4d-b5b9-67506341be06 req-ec2fb55a-141e-4da4-a2e9-e46afc5cdd34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0b0841-bd90-4361-9866-e51a7c5db994", "name": "network-vif-plugged", "status": "completed", "tag": "6eaca3f7-b87d-4766-ad60-73f678ccc493"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:58:40.529872 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-eda4e6a8-9b8a-4d4d-b5b9-67506341be06 req-ec2fb55a-141e-4da4-a2e9-e46afc5cdd34 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:40.530680 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-eda4e6a8-9b8a-4d4d-b5b9-67506341be06 req-ec2fb55a-141e-4da4-a2e9-e46afc5cdd34 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:40.545468 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-eda4e6a8-9b8a-4d4d-b5b9-67506341be06 req-ec2fb55a-141e-4da4-a2e9-e46afc5cdd34 service nova] Creating event network-vif-plugged:6eaca3f7-b87d-4766-ad60-73f678ccc493 for instance fb0b0841-bd90-4361-9866-e51a7c5db994 on hv-cinder-82549 Jul 27 07:58:40.555213 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-eda4e6a8-9b8a-4d4d-b5b9-67506341be06 req-ec2fb55a-141e-4da4-a2e9-e46afc5cdd34 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040970 Jul 27 07:58:40.556148 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 511/1046] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:58:40.588615 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-045bf0ce-beb9-4113-a4fa-ee4ce600efc4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:40.596900 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-045bf0ce-beb9-4113-a4fa-ee4ce600efc4 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1573 microversion: 2.1 time: 0.193433 Jul 27 07:58:40.597416 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 536/1047] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:40 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1573 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:58:41.619415 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-bf6d5dde-0442-4ec5-84fb-99f1cbb8a939 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:41.620112 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-bf6d5dde-0442-4ec5-84fb-99f1cbb8a939 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:41.627220 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bf6d5dde-0442-4ec5-84fb-99f1cbb8a939 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:41.627579 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bf6d5dde-0442-4ec5-84fb-99f1cbb8a939 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:41.628354 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bf6d5dde-0442-4ec5-84fb-99f1cbb8a939 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:41.628778 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bf6d5dde-0442-4ec5-84fb-99f1cbb8a939 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:41.939975 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-bf6d5dde-0442-4ec5-84fb-99f1cbb8a939 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:41.950521 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-bf6d5dde-0442-4ec5-84fb-99f1cbb8a939 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1573 microversion: 2.1 time: 0.335371 Jul 27 07:58:41.952263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 512/1048] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:41 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1573 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:42.041704 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-1358410c-e21c-4e89-a3a9-6f3da1825ed2 req-72720cda-0928-4ad3-a21e-5aa37c6b3c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aea362c-4af7-4df2-ac79-952869e1d458", "tag": "856b98bd-bf18-4a03-969a-994a99cb10fe"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:58:42.052569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-1358410c-e21c-4e89-a3a9-6f3da1825ed2 req-72720cda-0928-4ad3-a21e-5aa37c6b3c0b service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:42.053034 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-1358410c-e21c-4e89-a3a9-6f3da1825ed2 req-72720cda-0928-4ad3-a21e-5aa37c6b3c0b service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:42.065018 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-1358410c-e21c-4e89-a3a9-6f3da1825ed2 req-72720cda-0928-4ad3-a21e-5aa37c6b3c0b service nova] Creating event network-changed:856b98bd-bf18-4a03-969a-994a99cb10fe for instance 4aea362c-4af7-4df2-ac79-952869e1d458 on hv-cinder-82549 Jul 27 07:58:42.070928 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-1358410c-e21c-4e89-a3a9-6f3da1825ed2 req-72720cda-0928-4ad3-a21e-5aa37c6b3c0b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034480 Jul 27 07:58:42.071883 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 537/1049] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:58:42.976704 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-85b63fc7-4fac-48f1-b31a-13115d02462a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:42.977450 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-85b63fc7-4fac-48f1-b31a-13115d02462a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:42.987949 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-85b63fc7-4fac-48f1-b31a-13115d02462a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:42.988667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-85b63fc7-4fac-48f1-b31a-13115d02462a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:42.989765 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-85b63fc7-4fac-48f1-b31a-13115d02462a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:42.990556 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-85b63fc7-4fac-48f1-b31a-13115d02462a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:43.154458 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-85b63fc7-4fac-48f1-b31a-13115d02462a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:43.164861 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-85b63fc7-4fac-48f1-b31a-13115d02462a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1560 microversion: 2.1 time: 0.193027 Jul 27 07:58:43.165547 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 513/1050] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:58:42 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1560 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:58:45.560700 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4b060b92-3c56-4377-a98a-bff8817833cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:45.561318 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4b060b92-3c56-4377-a98a-bff8817833cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:45.568426 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4b060b92-3c56-4377-a98a-bff8817833cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:45.568901 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4b060b92-3c56-4377-a98a-bff8817833cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:45.570283 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4b060b92-3c56-4377-a98a-bff8817833cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:45.570727 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4b060b92-3c56-4377-a98a-bff8817833cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:45.595196 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4b060b92-3c56-4377-a98a-bff8817833cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2/ips" status: 200 len: 152 microversion: 2.20 time: 0.039701 Jul 27 07:58:45.595765 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 538/1051] 10.222.0.18 () {60 vars in 1289 bytes} [Wed Jul 27 07:58:45 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 07:58:47.865510 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9dc82d0b-a01c-4aa5-a60b-a20dee10150a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:58:47.867292 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-9dc82d0b-a01c-4aa5-a60b-a20dee10150a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:47.877111 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9dc82d0b-a01c-4aa5-a60b-a20dee10150a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:47.877802 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9dc82d0b-a01c-4aa5-a60b-a20dee10150a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:47.878754 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9dc82d0b-a01c-4aa5-a60b-a20dee10150a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:47.879187 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9dc82d0b-a01c-4aa5-a60b-a20dee10150a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:47.904514 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.objects.instance [None req-9dc82d0b-a01c-4aa5-a60b-a20dee10150a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lazy-loading 'flavor' on Instance uuid 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 {{(pid=117779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:58:48.112718 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9dc82d0b-a01c-4aa5-a60b-a20dee10150a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "POST /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2/action" status: 202 len: 0 microversion: 2.20 time: 0.251394 Jul 27 07:58:48.113347 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 514/1052] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Jul 27 07:58:47 2022] POST /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 07:58:48.123095 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0f38e891-235b-4445-8094-7cf275f689d4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:48.125351 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0f38e891-235b-4445-8094-7cf275f689d4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:48.133448 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0f38e891-235b-4445-8094-7cf275f689d4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:48.134150 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0f38e891-235b-4445-8094-7cf275f689d4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:48.135643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0f38e891-235b-4445-8094-7cf275f689d4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:48.136169 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0f38e891-235b-4445-8094-7cf275f689d4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:48.277915 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0f38e891-235b-4445-8094-7cf275f689d4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:48.285977 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0f38e891-235b-4445-8094-7cf275f689d4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:48.287510 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0f38e891-235b-4445-8094-7cf275f689d4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:48.289194 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0f38e891-235b-4445-8094-7cf275f689d4 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1725 microversion: 2.20 time: 0.170605 Jul 27 07:58:48.289751 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 539/1053] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:58:48 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:58:49.312956 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f738429f-7769-43b4-b387-5fe80c00ba4a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:49.313659 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f738429f-7769-43b4-b387-5fe80c00ba4a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:49.321499 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f738429f-7769-43b4-b387-5fe80c00ba4a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:49.321956 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f738429f-7769-43b4-b387-5fe80c00ba4a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:49.322852 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f738429f-7769-43b4-b387-5fe80c00ba4a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:49.323320 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f738429f-7769-43b4-b387-5fe80c00ba4a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:49.458492 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f738429f-7769-43b4-b387-5fe80c00ba4a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:49.467023 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f738429f-7769-43b4-b387-5fe80c00ba4a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:49.468526 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f738429f-7769-43b4-b387-5fe80c00ba4a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:49.469682 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f738429f-7769-43b4-b387-5fe80c00ba4a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1725 microversion: 2.20 time: 0.161502 Jul 27 07:58:49.470239 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 515/1054] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:58:49 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:58:50.494267 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3ee57ee2-6c5d-4e0f-b7bb-3485927bcf78 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:50.494901 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3ee57ee2-6c5d-4e0f-b7bb-3485927bcf78 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:50.501564 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3ee57ee2-6c5d-4e0f-b7bb-3485927bcf78 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:50.502025 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3ee57ee2-6c5d-4e0f-b7bb-3485927bcf78 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:50.502789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3ee57ee2-6c5d-4e0f-b7bb-3485927bcf78 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:50.503264 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3ee57ee2-6c5d-4e0f-b7bb-3485927bcf78 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:50.632236 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3ee57ee2-6c5d-4e0f-b7bb-3485927bcf78 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:50.640099 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3ee57ee2-6c5d-4e0f-b7bb-3485927bcf78 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:50.641656 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3ee57ee2-6c5d-4e0f-b7bb-3485927bcf78 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:50.642823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3ee57ee2-6c5d-4e0f-b7bb-3485927bcf78 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1725 microversion: 2.20 time: 0.153184 Jul 27 07:58:50.643414 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 540/1055] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:58:50 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:58:51.665564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c01b9229-5ba1-4995-85ad-82a92b9f58c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:51.666199 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c01b9229-5ba1-4995-85ad-82a92b9f58c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:51.672831 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c01b9229-5ba1-4995-85ad-82a92b9f58c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:51.673295 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c01b9229-5ba1-4995-85ad-82a92b9f58c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:51.674035 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c01b9229-5ba1-4995-85ad-82a92b9f58c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:51.674463 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c01b9229-5ba1-4995-85ad-82a92b9f58c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:51.808584 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c01b9229-5ba1-4995-85ad-82a92b9f58c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:51.816656 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c01b9229-5ba1-4995-85ad-82a92b9f58c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:51.818166 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c01b9229-5ba1-4995-85ad-82a92b9f58c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:51.820383 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c01b9229-5ba1-4995-85ad-82a92b9f58c3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1725 microversion: 2.20 time: 0.157702 Jul 27 07:58:51.820739 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 516/1056] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:58:51 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:58:52.842020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-978224a9-6671-4af4-a579-90aa0ede3415 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:52.842768 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-978224a9-6671-4af4-a579-90aa0ede3415 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:52.849713 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-978224a9-6671-4af4-a579-90aa0ede3415 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:52.850253 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-978224a9-6671-4af4-a579-90aa0ede3415 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:52.851429 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-978224a9-6671-4af4-a579-90aa0ede3415 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:52.851609 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-978224a9-6671-4af4-a579-90aa0ede3415 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:52.994366 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-978224a9-6671-4af4-a579-90aa0ede3415 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:53.002435 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-978224a9-6671-4af4-a579-90aa0ede3415 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:53.003985 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-978224a9-6671-4af4-a579-90aa0ede3415 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:53.005184 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-978224a9-6671-4af4-a579-90aa0ede3415 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1725 microversion: 2.20 time: 0.167084 Jul 27 07:58:53.005742 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 541/1057] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:58:52 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:58:54.029108 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2d0357e3-a55b-450c-9c89-8c10a185e4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:54.029689 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2d0357e3-a55b-450c-9c89-8c10a185e4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:54.036762 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2d0357e3-a55b-450c-9c89-8c10a185e4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:54.037226 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2d0357e3-a55b-450c-9c89-8c10a185e4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:54.038612 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2d0357e3-a55b-450c-9c89-8c10a185e4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:54.039101 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2d0357e3-a55b-450c-9c89-8c10a185e4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:54.183131 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2d0357e3-a55b-450c-9c89-8c10a185e4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:54.191881 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2d0357e3-a55b-450c-9c89-8c10a185e4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:54.193401 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2d0357e3-a55b-450c-9c89-8c10a185e4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:54.194632 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2d0357e3-a55b-450c-9c89-8c10a185e4dc tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1725 microversion: 2.20 time: 0.169668 Jul 27 07:58:54.195315 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 517/1058] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:58:54 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:58:55.220465 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ea74455b-16e6-4336-a06d-052ea9f5dc29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:55.221269 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ea74455b-16e6-4336-a06d-052ea9f5dc29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:55.228234 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ea74455b-16e6-4336-a06d-052ea9f5dc29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:55.228685 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ea74455b-16e6-4336-a06d-052ea9f5dc29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:55.229453 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ea74455b-16e6-4336-a06d-052ea9f5dc29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:55.229899 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ea74455b-16e6-4336-a06d-052ea9f5dc29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:55.361424 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ea74455b-16e6-4336-a06d-052ea9f5dc29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:55.370227 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ea74455b-16e6-4336-a06d-052ea9f5dc29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:55.371825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ea74455b-16e6-4336-a06d-052ea9f5dc29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:55.373027 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ea74455b-16e6-4336-a06d-052ea9f5dc29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1725 microversion: 2.20 time: 0.156823 Jul 27 07:58:55.373593 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 542/1059] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:58:55 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:58:56.395943 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-60d7e3e6-fabe-4f01-a433-55bc9fcf7bfe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:56.396610 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-60d7e3e6-fabe-4f01-a433-55bc9fcf7bfe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:56.399096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=46 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:56.404607 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-60d7e3e6-fabe-4f01-a433-55bc9fcf7bfe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:56.405026 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-60d7e3e6-fabe-4f01-a433-55bc9fcf7bfe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:56.405784 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-60d7e3e6-fabe-4f01-a433-55bc9fcf7bfe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:56.406211 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-60d7e3e6-fabe-4f01-a433-55bc9fcf7bfe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:56.533176 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-60d7e3e6-fabe-4f01-a433-55bc9fcf7bfe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:56.541526 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-60d7e3e6-fabe-4f01-a433-55bc9fcf7bfe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:56.543042 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-60d7e3e6-fabe-4f01-a433-55bc9fcf7bfe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:56.544189 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-60d7e3e6-fabe-4f01-a433-55bc9fcf7bfe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1725 microversion: 2.20 time: 0.152339 Jul 27 07:58:56.544742 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 518/1060] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:58:56 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:58:57.567424 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a1592802-7d00-4920-9655-54eaad2aa04c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:57.568030 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a1592802-7d00-4920-9655-54eaad2aa04c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:57.575031 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a1592802-7d00-4920-9655-54eaad2aa04c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:57.575477 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a1592802-7d00-4920-9655-54eaad2aa04c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:57.576240 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a1592802-7d00-4920-9655-54eaad2aa04c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:57.576670 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a1592802-7d00-4920-9655-54eaad2aa04c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:57.706378 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a1592802-7d00-4920-9655-54eaad2aa04c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:57.714266 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a1592802-7d00-4920-9655-54eaad2aa04c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:57.715915 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a1592802-7d00-4920-9655-54eaad2aa04c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:57.717054 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a1592802-7d00-4920-9655-54eaad2aa04c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1725 microversion: 2.20 time: 0.153566 Jul 27 07:58:57.717607 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 543/1061] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:58:57 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:58:58.740634 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2e53f585-1ce1-49d1-8a94-40c79b36f5e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:58.741171 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2e53f585-1ce1-49d1-8a94-40c79b36f5e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:58.747878 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2e53f585-1ce1-49d1-8a94-40c79b36f5e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:58.748340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2e53f585-1ce1-49d1-8a94-40c79b36f5e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:58.749113 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2e53f585-1ce1-49d1-8a94-40c79b36f5e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:58.749547 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2e53f585-1ce1-49d1-8a94-40c79b36f5e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:58.886645 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2e53f585-1ce1-49d1-8a94-40c79b36f5e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:58.890073 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:58.895894 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2e53f585-1ce1-49d1-8a94-40c79b36f5e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:58.897406 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2e53f585-1ce1-49d1-8a94-40c79b36f5e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:58:58.899336 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2e53f585-1ce1-49d1-8a94-40c79b36f5e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1725 microversion: 2.20 time: 0.162056 Jul 27 07:58:58.899931 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 519/1062] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:58:58 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:58:59.922142 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-56c9904b-7feb-44d9-9067-a963ed5b97f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:58:59.922739 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-56c9904b-7feb-44d9-9067-a963ed5b97f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:58:59.925258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=40 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:58:59.930676 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-56c9904b-7feb-44d9-9067-a963ed5b97f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:59.931145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-56c9904b-7feb-44d9-9067-a963ed5b97f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:58:59.931897 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-56c9904b-7feb-44d9-9067-a963ed5b97f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:58:59.932330 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-56c9904b-7feb-44d9-9067-a963ed5b97f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:00.064978 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-56c9904b-7feb-44d9-9067-a963ed5b97f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:00.072862 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-56c9904b-7feb-44d9-9067-a963ed5b97f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:00.074353 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-56c9904b-7feb-44d9-9067-a963ed5b97f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:00.075557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-56c9904b-7feb-44d9-9067-a963ed5b97f3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1746 microversion: 2.20 time: 0.157336 Jul 27 07:59:00.076116 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 544/1063] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:58:59 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:01.099692 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b4a96561-d867-4862-9f24-d3acf4e71cd9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:01.100348 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b4a96561-d867-4862-9f24-d3acf4e71cd9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:01.108449 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b4a96561-d867-4862-9f24-d3acf4e71cd9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:01.108891 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b4a96561-d867-4862-9f24-d3acf4e71cd9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:01.109644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b4a96561-d867-4862-9f24-d3acf4e71cd9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:01.110073 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b4a96561-d867-4862-9f24-d3acf4e71cd9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:01.237515 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b4a96561-d867-4862-9f24-d3acf4e71cd9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:01.246014 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b4a96561-d867-4862-9f24-d3acf4e71cd9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:01.247566 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b4a96561-d867-4862-9f24-d3acf4e71cd9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:01.248726 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b4a96561-d867-4862-9f24-d3acf4e71cd9 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1746 microversion: 2.20 time: 0.153282 Jul 27 07:59:01.249302 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 520/1064] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:01 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:02.271677 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7b2b7a26-1452-4b25-aa30-dc4015b4d00f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:02.272281 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7b2b7a26-1452-4b25-aa30-dc4015b4d00f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:02.278841 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7b2b7a26-1452-4b25-aa30-dc4015b4d00f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:02.279312 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7b2b7a26-1452-4b25-aa30-dc4015b4d00f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:02.280097 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7b2b7a26-1452-4b25-aa30-dc4015b4d00f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:02.280530 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7b2b7a26-1452-4b25-aa30-dc4015b4d00f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:02.420841 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7b2b7a26-1452-4b25-aa30-dc4015b4d00f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:02.431183 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7b2b7a26-1452-4b25-aa30-dc4015b4d00f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:02.432729 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7b2b7a26-1452-4b25-aa30-dc4015b4d00f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:02.433927 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7b2b7a26-1452-4b25-aa30-dc4015b4d00f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1746 microversion: 2.20 time: 0.166209 Jul 27 07:59:02.434489 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 545/1065] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:02 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:03.457414 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2c7e1b48-11d3-439d-89a2-f88f8e132bb5 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:03.458018 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2c7e1b48-11d3-439d-89a2-f88f8e132bb5 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:03.465148 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2c7e1b48-11d3-439d-89a2-f88f8e132bb5 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:03.465596 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2c7e1b48-11d3-439d-89a2-f88f8e132bb5 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:03.466360 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2c7e1b48-11d3-439d-89a2-f88f8e132bb5 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:03.466792 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2c7e1b48-11d3-439d-89a2-f88f8e132bb5 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:03.601476 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2c7e1b48-11d3-439d-89a2-f88f8e132bb5 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:03.609473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2c7e1b48-11d3-439d-89a2-f88f8e132bb5 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:03.611032 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2c7e1b48-11d3-439d-89a2-f88f8e132bb5 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:03.612191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2c7e1b48-11d3-439d-89a2-f88f8e132bb5 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1746 microversion: 2.20 time: 0.158787 Jul 27 07:59:03.612755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 521/1066] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:03 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:04.609844 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-80816447-ac0b-4f9e-b09c-414a2f76c0f2 req-de922b91-3c23-4dbc-be37-c1f4895797b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2", "name": "network-vif-plugged", "status": "completed", "tag": "19f48487-6051-4c27-9a27-015b3b0d174a"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:59:04.619771 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-80816447-ac0b-4f9e-b09c-414a2f76c0f2 req-de922b91-3c23-4dbc-be37-c1f4895797b7 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:04.620217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-80816447-ac0b-4f9e-b09c-414a2f76c0f2 req-de922b91-3c23-4dbc-be37-c1f4895797b7 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:04.631742 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-80816447-ac0b-4f9e-b09c-414a2f76c0f2 req-de922b91-3c23-4dbc-be37-c1f4895797b7 service nova] Creating event network-vif-plugged:19f48487-6051-4c27-9a27-015b3b0d174a for instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 on hv-cinder-82549 Jul 27 07:59:04.635503 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-91283f07-0d0e-4c05-84e8-273ca32d11ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:04.636638 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-80816447-ac0b-4f9e-b09c-414a2f76c0f2 req-de922b91-3c23-4dbc-be37-c1f4895797b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030529 Jul 27 07:59:04.636792 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-91283f07-0d0e-4c05-84e8-273ca32d11ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:04.637562 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 546/1067] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:59:04.644530 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-91283f07-0d0e-4c05-84e8-273ca32d11ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:04.645313 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-91283f07-0d0e-4c05-84e8-273ca32d11ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:04.646401 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-91283f07-0d0e-4c05-84e8-273ca32d11ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:04.646857 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-91283f07-0d0e-4c05-84e8-273ca32d11ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:04.777932 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-91283f07-0d0e-4c05-84e8-273ca32d11ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:04.786070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-91283f07-0d0e-4c05-84e8-273ca32d11ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:04.787660 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-91283f07-0d0e-4c05-84e8-273ca32d11ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:04.788844 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-91283f07-0d0e-4c05-84e8-273ca32d11ab tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1746 microversion: 2.20 time: 0.157375 Jul 27 07:59:04.789403 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 522/1068] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:04 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:59:05.812813 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6e0f9944-8aa7-42f0-8a3e-92734c506de8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:05.813507 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6e0f9944-8aa7-42f0-8a3e-92734c506de8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:05.819685 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6e0f9944-8aa7-42f0-8a3e-92734c506de8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:05.820123 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6e0f9944-8aa7-42f0-8a3e-92734c506de8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:05.820882 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6e0f9944-8aa7-42f0-8a3e-92734c506de8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:05.821312 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6e0f9944-8aa7-42f0-8a3e-92734c506de8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:05.954279 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6e0f9944-8aa7-42f0-8a3e-92734c506de8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:05.962858 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6e0f9944-8aa7-42f0-8a3e-92734c506de8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:05.964431 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6e0f9944-8aa7-42f0-8a3e-92734c506de8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:05.965623 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6e0f9944-8aa7-42f0-8a3e-92734c506de8 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1746 microversion: 2.20 time: 0.157576 Jul 27 07:59:05.966187 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 547/1069] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:05 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:06.989314 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-26ec7bc2-9e32-4185-95bd-a8e814f8cf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:06.990067 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-26ec7bc2-9e32-4185-95bd-a8e814f8cf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:06.997512 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-26ec7bc2-9e32-4185-95bd-a8e814f8cf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:06.997963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-26ec7bc2-9e32-4185-95bd-a8e814f8cf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:06.998732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-26ec7bc2-9e32-4185-95bd-a8e814f8cf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:06.999192 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-26ec7bc2-9e32-4185-95bd-a8e814f8cf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:07.149465 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-26ec7bc2-9e32-4185-95bd-a8e814f8cf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:07.157577 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-26ec7bc2-9e32-4185-95bd-a8e814f8cf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:07.159151 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-26ec7bc2-9e32-4185-95bd-a8e814f8cf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:07.160317 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-26ec7bc2-9e32-4185-95bd-a8e814f8cf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1741 microversion: 2.20 time: 0.174814 Jul 27 07:59:07.160881 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 523/1070] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:06 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:08.184781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-79676fbb-b978-44f2-a70e-86de18ead9fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:08.185427 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-79676fbb-b978-44f2-a70e-86de18ead9fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:08.192201 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-79676fbb-b978-44f2-a70e-86de18ead9fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:08.192671 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-79676fbb-b978-44f2-a70e-86de18ead9fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:08.193506 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-79676fbb-b978-44f2-a70e-86de18ead9fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:08.193952 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-79676fbb-b978-44f2-a70e-86de18ead9fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:08.333089 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-79676fbb-b978-44f2-a70e-86de18ead9fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:08.342979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-79676fbb-b978-44f2-a70e-86de18ead9fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:08.344755 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-79676fbb-b978-44f2-a70e-86de18ead9fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:08.345913 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-79676fbb-b978-44f2-a70e-86de18ead9fe tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1741 microversion: 2.20 time: 0.165092 Jul 27 07:59:08.347837 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 548/1071] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:08 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:09.369790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d03ac3fd-8434-43bb-ba98-838727d4614b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:09.370513 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d03ac3fd-8434-43bb-ba98-838727d4614b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:09.377550 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d03ac3fd-8434-43bb-ba98-838727d4614b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:09.377991 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d03ac3fd-8434-43bb-ba98-838727d4614b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:09.378759 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d03ac3fd-8434-43bb-ba98-838727d4614b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:09.379221 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d03ac3fd-8434-43bb-ba98-838727d4614b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:09.540339 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d03ac3fd-8434-43bb-ba98-838727d4614b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:09.549613 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d03ac3fd-8434-43bb-ba98-838727d4614b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:09.551159 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d03ac3fd-8434-43bb-ba98-838727d4614b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:09.552631 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d03ac3fd-8434-43bb-ba98-838727d4614b tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1741 microversion: 2.20 time: 0.186893 Jul 27 07:59:09.573196 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 524/1072] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:09 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1741 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:10.576956 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3239a104-b9ca-426e-8f38-72c8621daf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:10.577580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3239a104-b9ca-426e-8f38-72c8621daf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:10.585025 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3239a104-b9ca-426e-8f38-72c8621daf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:10.586175 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3239a104-b9ca-426e-8f38-72c8621daf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:10.587019 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3239a104-b9ca-426e-8f38-72c8621daf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:10.587454 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3239a104-b9ca-426e-8f38-72c8621daf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:10.592200 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=77 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:59:10.725029 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3239a104-b9ca-426e-8f38-72c8621daf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:10.733786 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3239a104-b9ca-426e-8f38-72c8621daf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:10.735319 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3239a104-b9ca-426e-8f38-72c8621daf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:10.736474 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3239a104-b9ca-426e-8f38-72c8621daf0c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1741 microversion: 2.20 time: 0.163821 Jul 27 07:59:10.737024 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 549/1073] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:10 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:11.759391 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-04870987-975d-4499-83f1-c1c25e3a42cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:11.760268 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-04870987-975d-4499-83f1-c1c25e3a42cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:11.766748 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-04870987-975d-4499-83f1-c1c25e3a42cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:11.767353 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-04870987-975d-4499-83f1-c1c25e3a42cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:11.767997 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-04870987-975d-4499-83f1-c1c25e3a42cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:11.768429 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-04870987-975d-4499-83f1-c1c25e3a42cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:11.920355 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-04870987-975d-4499-83f1-c1c25e3a42cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:11.935547 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-04870987-975d-4499-83f1-c1c25e3a42cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:11.938792 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-04870987-975d-4499-83f1-c1c25e3a42cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:11.940067 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-04870987-975d-4499-83f1-c1c25e3a42cb tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1741 microversion: 2.20 time: 0.185186 Jul 27 07:59:11.940640 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 525/1074] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:11 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:12.964748 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2655df6a-8e5d-4906-9efa-9fc997832710 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:12.965610 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2655df6a-8e5d-4906-9efa-9fc997832710 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:12.972708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2655df6a-8e5d-4906-9efa-9fc997832710 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:12.973158 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2655df6a-8e5d-4906-9efa-9fc997832710 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:12.973929 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2655df6a-8e5d-4906-9efa-9fc997832710 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:12.974359 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2655df6a-8e5d-4906-9efa-9fc997832710 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:13.000190 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-417eadcc-fe12-4d73-b73d-8498b450b511 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:13.001451 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-417eadcc-fe12-4d73-b73d-8498b450b511 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:13.010066 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-417eadcc-fe12-4d73-b73d-8498b450b511 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:13.010915 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-417eadcc-fe12-4d73-b73d-8498b450b511 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:13.011984 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-417eadcc-fe12-4d73-b73d-8498b450b511 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:13.012653 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-417eadcc-fe12-4d73-b73d-8498b450b511 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:13.047375 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-417eadcc-fe12-4d73-b73d-8498b450b511 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/ips" status: 200 len: 144 microversion: 2.1 time: 0.051018 Jul 27 07:59:13.057161 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 526/1075] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Jul 27 07:59:12 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/ips => generated 144 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:59:13.134631 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2655df6a-8e5d-4906-9efa-9fc997832710 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:13.143973 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2655df6a-8e5d-4906-9efa-9fc997832710 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:13.145666 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2655df6a-8e5d-4906-9efa-9fc997832710 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:13.147174 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2655df6a-8e5d-4906-9efa-9fc997832710 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1741 microversion: 2.20 time: 0.186863 Jul 27 07:59:13.151268 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 550/1076] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:12 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1741 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:14.172146 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-136b5564-ed58-4273-8eea-16eb963ce1ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:14.172907 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-136b5564-ed58-4273-8eea-16eb963ce1ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:14.179501 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-136b5564-ed58-4273-8eea-16eb963ce1ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:14.179953 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-136b5564-ed58-4273-8eea-16eb963ce1ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:14.180730 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-136b5564-ed58-4273-8eea-16eb963ce1ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:14.181168 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-136b5564-ed58-4273-8eea-16eb963ce1ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:14.332737 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-136b5564-ed58-4273-8eea-16eb963ce1ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:14.343582 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-136b5564-ed58-4273-8eea-16eb963ce1ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:14.345109 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-136b5564-ed58-4273-8eea-16eb963ce1ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:14.346543 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-136b5564-ed58-4273-8eea-16eb963ce1ac tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1741 microversion: 2.20 time: 0.179561 Jul 27 07:59:14.347143 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 527/1077] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:14 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:14.453925 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e63da4d2-d47e-4bd0-a057-0f00b9d9769c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19e7c77d-1c67-4c5d-b221-09b10f7e0855"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:59:14.456327 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e63da4d2-d47e-4bd0-a057-0f00b9d9769c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:14.463996 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e63da4d2-d47e-4bd0-a057-0f00b9d9769c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:14.464454 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e63da4d2-d47e-4bd0-a057-0f00b9d9769c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:14.465241 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e63da4d2-d47e-4bd0-a057-0f00b9d9769c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:14.465681 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e63da4d2-d47e-4bd0-a057-0f00b9d9769c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:14.788882 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e63da4d2-d47e-4bd0-a057-0f00b9d9769c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "POST /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338532 Jul 27 07:59:14.789600 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 551/1078] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Jul 27 07:59:14 2022] POST /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:59:15.370261 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-8dd62025-a46f-4d51-b9dc-74cf005a1515 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:15.370936 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-8dd62025-a46f-4d51-b9dc-74cf005a1515 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:15.377465 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8dd62025-a46f-4d51-b9dc-74cf005a1515 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:15.377913 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8dd62025-a46f-4d51-b9dc-74cf005a1515 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:15.378687 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8dd62025-a46f-4d51-b9dc-74cf005a1515 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:15.379134 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8dd62025-a46f-4d51-b9dc-74cf005a1515 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:15.530053 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8dd62025-a46f-4d51-b9dc-74cf005a1515 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:15.538721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8dd62025-a46f-4d51-b9dc-74cf005a1515 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:15.540271 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8dd62025-a46f-4d51-b9dc-74cf005a1515 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:15.541703 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-8dd62025-a46f-4d51-b9dc-74cf005a1515 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1741 microversion: 2.20 time: 0.175302 Jul 27 07:59:15.554937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 528/1079] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:15 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:16.568204 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-77b79b5d-4981-497f-a666-45d4a52482c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:16.568936 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-77b79b5d-4981-497f-a666-45d4a52482c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:16.576008 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-77b79b5d-4981-497f-a666-45d4a52482c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:16.576448 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-77b79b5d-4981-497f-a666-45d4a52482c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:16.577435 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-77b79b5d-4981-497f-a666-45d4a52482c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:16.577871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-77b79b5d-4981-497f-a666-45d4a52482c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:16.713587 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-77b79b5d-4981-497f-a666-45d4a52482c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:16.727256 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-77b79b5d-4981-497f-a666-45d4a52482c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:16.729135 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-77b79b5d-4981-497f-a666-45d4a52482c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:16.730424 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-77b79b5d-4981-497f-a666-45d4a52482c7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1741 microversion: 2.20 time: 0.166993 Jul 27 07:59:16.731412 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 552/1080] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:16 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:17.756481 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c73e8a77-6410-450e-96dc-511339dce6cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:17.757524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c73e8a77-6410-450e-96dc-511339dce6cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:17.764385 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c73e8a77-6410-450e-96dc-511339dce6cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:17.765089 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c73e8a77-6410-450e-96dc-511339dce6cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:17.765907 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c73e8a77-6410-450e-96dc-511339dce6cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:17.766726 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c73e8a77-6410-450e-96dc-511339dce6cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:17.940888 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c73e8a77-6410-450e-96dc-511339dce6cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:17.950152 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c73e8a77-6410-450e-96dc-511339dce6cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:17.951687 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c73e8a77-6410-450e-96dc-511339dce6cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:17.953057 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c73e8a77-6410-450e-96dc-511339dce6cd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1741 microversion: 2.20 time: 0.200715 Jul 27 07:59:17.953610 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 529/1081] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:17 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1741 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:18.976255 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f642eedd-2eb0-47eb-924b-4c0f8d823458 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:18.976892 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f642eedd-2eb0-47eb-924b-4c0f8d823458 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:18.983502 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f642eedd-2eb0-47eb-924b-4c0f8d823458 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:18.983947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f642eedd-2eb0-47eb-924b-4c0f8d823458 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:18.984712 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f642eedd-2eb0-47eb-924b-4c0f8d823458 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:18.985141 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f642eedd-2eb0-47eb-924b-4c0f8d823458 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:19.117000 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f642eedd-2eb0-47eb-924b-4c0f8d823458 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:19.125141 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f642eedd-2eb0-47eb-924b-4c0f8d823458 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:19.126685 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f642eedd-2eb0-47eb-924b-4c0f8d823458 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:19.127881 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f642eedd-2eb0-47eb-924b-4c0f8d823458 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1741 microversion: 2.20 time: 0.155695 Jul 27 07:59:19.128430 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 553/1082] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:18 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1741 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:20.151655 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b48ae2a5-7961-49cb-ba90-76e189690ccd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:20.152268 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b48ae2a5-7961-49cb-ba90-76e189690ccd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:20.158801 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b48ae2a5-7961-49cb-ba90-76e189690ccd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:20.159287 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b48ae2a5-7961-49cb-ba90-76e189690ccd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:20.160060 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b48ae2a5-7961-49cb-ba90-76e189690ccd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:20.160499 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b48ae2a5-7961-49cb-ba90-76e189690ccd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:20.290939 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b48ae2a5-7961-49cb-ba90-76e189690ccd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:20.298766 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b48ae2a5-7961-49cb-ba90-76e189690ccd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:20.300294 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b48ae2a5-7961-49cb-ba90-76e189690ccd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:20.301431 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b48ae2a5-7961-49cb-ba90-76e189690ccd tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1723 microversion: 2.20 time: 0.154245 Jul 27 07:59:20.301984 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 530/1083] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:20 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:21.325858 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b0b9d635-4462-469b-abc7-0aaf75351b14 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:21.326475 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b0b9d635-4462-469b-abc7-0aaf75351b14 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:21.333034 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b0b9d635-4462-469b-abc7-0aaf75351b14 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:21.333490 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b0b9d635-4462-469b-abc7-0aaf75351b14 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:21.334262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b0b9d635-4462-469b-abc7-0aaf75351b14 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:21.334706 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b0b9d635-4462-469b-abc7-0aaf75351b14 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:21.464571 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b0b9d635-4462-469b-abc7-0aaf75351b14 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:21.472704 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b0b9d635-4462-469b-abc7-0aaf75351b14 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:21.474196 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b0b9d635-4462-469b-abc7-0aaf75351b14 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:21.475379 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b0b9d635-4462-469b-abc7-0aaf75351b14 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1723 microversion: 2.20 time: 0.153491 Jul 27 07:59:21.475954 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 554/1084] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:21 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:22.498836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-dce52418-8ecc-40a0-9eda-6f111b6ef53c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:22.499593 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-dce52418-8ecc-40a0-9eda-6f111b6ef53c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:22.507145 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dce52418-8ecc-40a0-9eda-6f111b6ef53c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:22.507592 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dce52418-8ecc-40a0-9eda-6f111b6ef53c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:22.508963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dce52418-8ecc-40a0-9eda-6f111b6ef53c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:22.509402 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dce52418-8ecc-40a0-9eda-6f111b6ef53c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:22.643095 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-dce52418-8ecc-40a0-9eda-6f111b6ef53c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:22.651668 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-dce52418-8ecc-40a0-9eda-6f111b6ef53c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:22.653191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-dce52418-8ecc-40a0-9eda-6f111b6ef53c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:22.654400 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-dce52418-8ecc-40a0-9eda-6f111b6ef53c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1726 microversion: 2.20 time: 0.159856 Jul 27 07:59:22.655003 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 531/1085] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:22 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:22.677597 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-23d50e42-fece-46f9-bb3e-380a5ea4f8ef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b036a0c2-c3c7-467a-82a2-e9e02ddd6982"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:59:22.680155 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-23d50e42-fece-46f9-bb3e-380a5ea4f8ef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:22.686608 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-23d50e42-fece-46f9-bb3e-380a5ea4f8ef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:22.687090 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-23d50e42-fece-46f9-bb3e-380a5ea4f8ef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:22.687862 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-23d50e42-fece-46f9-bb3e-380a5ea4f8ef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:22.688486 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-23d50e42-fece-46f9-bb3e-380a5ea4f8ef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:22.707230 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-bb951194-a843-41b0-8126-91a80ed0e956 req-44eac793-f38a-4a51-aee0-a9fd27172bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2", "name": "network-vif-unplugged", "status": "completed", "tag": "19f48487-6051-4c27-9a27-015b3b0d174a"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:59:22.718328 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-bb951194-a843-41b0-8126-91a80ed0e956 req-44eac793-f38a-4a51-aee0-a9fd27172bbd service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:22.719033 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-bb951194-a843-41b0-8126-91a80ed0e956 req-44eac793-f38a-4a51-aee0-a9fd27172bbd service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:22.731729 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-bb951194-a843-41b0-8126-91a80ed0e956 req-44eac793-f38a-4a51-aee0-a9fd27172bbd service nova] Creating event network-vif-unplugged:19f48487-6051-4c27-9a27-015b3b0d174a for instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 on hv-cinder-82549 Jul 27 07:59:22.736309 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-bb951194-a843-41b0-8126-91a80ed0e956 req-44eac793-f38a-4a51-aee0-a9fd27172bbd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032868 Jul 27 07:59:22.737344 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 532/1086] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:59:22.971243 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-23d50e42-fece-46f9-bb3e-380a5ea4f8ef tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "POST /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.297502 Jul 27 07:59:22.971855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 555/1087] 10.222.0.18 () {62 vars in 1364 bytes} [Wed Jul 27 07:59:22 2022] POST /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2/os-volume_attachments => generated 188 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 07:59:23.098062 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-6186599a-eb97-46b1-b8ae-6bc1d9cb799e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:23.098641 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-6186599a-eb97-46b1-b8ae-6bc1d9cb799e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:23.105006 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6186599a-eb97-46b1-b8ae-6bc1d9cb799e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:23.105466 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6186599a-eb97-46b1-b8ae-6bc1d9cb799e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:23.106229 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6186599a-eb97-46b1-b8ae-6bc1d9cb799e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:23.106667 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6186599a-eb97-46b1-b8ae-6bc1d9cb799e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:23.353489 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-6186599a-eb97-46b1-b8ae-6bc1d9cb799e tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2/os-volume_attachments/b036a0c2-c3c7-467a-82a2-e9e02ddd6982" status: 202 len: 0 microversion: 2.20 time: 0.259905 Jul 27 07:59:23.354134 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 533/1088] 10.222.0.18 () {60 vars in 1457 bytes} [Wed Jul 27 07:59:23 2022] DELETE /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2/os-volume_attachments/b036a0c2-c3c7-467a-82a2-e9e02ddd6982 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 07:59:23.415162 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-acb6b4b5-14ff-493b-94b3-079e2e3a792f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:59:23.415738 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-acb6b4b5-14ff-493b-94b3-079e2e3a792f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:23.421981 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-acb6b4b5-14ff-493b-94b3-079e2e3a792f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:23.422428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-acb6b4b5-14ff-493b-94b3-079e2e3a792f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:23.423338 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-acb6b4b5-14ff-493b-94b3-079e2e3a792f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:23.423778 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-acb6b4b5-14ff-493b-94b3-079e2e3a792f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:23.434648 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1cb9821e-11ed-45c8-a4ab-f84a6e3cd562 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:23.436928 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1cb9821e-11ed-45c8-a4ab-f84a6e3cd562 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:23.446329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1cb9821e-11ed-45c8-a4ab-f84a6e3cd562 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:23.446780 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1cb9821e-11ed-45c8-a4ab-f84a6e3cd562 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:23.447599 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1cb9821e-11ed-45c8-a4ab-f84a6e3cd562 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:23.448103 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1cb9821e-11ed-45c8-a4ab-f84a6e3cd562 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:23.478484 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1cb9821e-11ed-45c8-a4ab-f84a6e3cd562 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047904 Jul 27 07:59:23.479096 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 534/1089] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:59:23 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:59:23.489496 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-85861d27-75f2-483f-8deb-cefb61a4ce66 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:23.490023 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-85861d27-75f2-483f-8deb-cefb61a4ce66 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:23.496659 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-85861d27-75f2-483f-8deb-cefb61a4ce66 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:23.497112 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-85861d27-75f2-483f-8deb-cefb61a4ce66 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:23.497894 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-85861d27-75f2-483f-8deb-cefb61a4ce66 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:23.498330 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-85861d27-75f2-483f-8deb-cefb61a4ce66 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:23.501183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:59:23.524482 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-acb6b4b5-14ff-493b-94b3-079e2e3a792f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "POST /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2/action" status: 202 len: 0 microversion: 2.20 time: 0.113751 Jul 27 07:59:23.525333 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 556/1090] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Jul 27 07:59:23 2022] POST /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 07:59:23.533076 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-85861d27-75f2-483f-8deb-cefb61a4ce66 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments/19e7c77d-1c67-4c5d-b221-09b10f7e0855" status: 200 len: 194 microversion: 2.1 time: 0.046993 Jul 27 07:59:23.533202 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f7b49325-8c81-4b4e-97b5-b21495b62281 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:23.533726 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f7b49325-8c81-4b4e-97b5-b21495b62281 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:23.533883 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 535/1091] 10.222.0.18 () {58 vars in 1413 bytes} [Wed Jul 27 07:59:23 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments/19e7c77d-1c67-4c5d-b221-09b10f7e0855 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:59:23.540452 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f7b49325-8c81-4b4e-97b5-b21495b62281 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:23.540902 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f7b49325-8c81-4b4e-97b5-b21495b62281 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:23.542327 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f7b49325-8c81-4b4e-97b5-b21495b62281 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:23.542777 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f7b49325-8c81-4b4e-97b5-b21495b62281 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:23.698217 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f7b49325-8c81-4b4e-97b5-b21495b62281 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:23.708022 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f7b49325-8c81-4b4e-97b5-b21495b62281 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:23.710874 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f7b49325-8c81-4b4e-97b5-b21495b62281 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:23.712543 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f7b49325-8c81-4b4e-97b5-b21495b62281 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1674 microversion: 2.20 time: 0.183012 Jul 27 07:59:23.713121 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 557/1092] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:23 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1674 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:59:24.738009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7a04b7d0-a977-4616-be26-0b8e2725d332 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:24.738611 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-7a04b7d0-a977-4616-be26-0b8e2725d332 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:24.745637 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7a04b7d0-a977-4616-be26-0b8e2725d332 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:24.746082 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7a04b7d0-a977-4616-be26-0b8e2725d332 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:24.746843 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7a04b7d0-a977-4616-be26-0b8e2725d332 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:24.747303 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7a04b7d0-a977-4616-be26-0b8e2725d332 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:24.882666 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7a04b7d0-a977-4616-be26-0b8e2725d332 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:24.891728 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7a04b7d0-a977-4616-be26-0b8e2725d332 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:24.893636 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7a04b7d0-a977-4616-be26-0b8e2725d332 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:24.894825 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7a04b7d0-a977-4616-be26-0b8e2725d332 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.161069 Jul 27 07:59:24.895716 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 536/1093] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:24 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:24.911151 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-41a4ccea-f52b-408a-8f85-c06000e2aa13 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7447b848-8c10-421c-b4b8-22f84a7fa84d"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:59:24.913772 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-41a4ccea-f52b-408a-8f85-c06000e2aa13 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:24.920645 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-41a4ccea-f52b-408a-8f85-c06000e2aa13 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:24.921095 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-41a4ccea-f52b-408a-8f85-c06000e2aa13 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:24.921911 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-41a4ccea-f52b-408a-8f85-c06000e2aa13 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:24.922346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-41a4ccea-f52b-408a-8f85-c06000e2aa13 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:25.189470 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-41a4ccea-f52b-408a-8f85-c06000e2aa13 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "POST /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282351 Jul 27 07:59:25.195362 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 558/1094] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Jul 27 07:59:24 2022] POST /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:59:25.920909 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-508b32ec-8e86-4b65-be31-e6608a6f0022 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:25.921970 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-508b32ec-8e86-4b65-be31-e6608a6f0022 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:25.933907 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-508b32ec-8e86-4b65-be31-e6608a6f0022 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:25.934565 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-508b32ec-8e86-4b65-be31-e6608a6f0022 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:25.937489 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-508b32ec-8e86-4b65-be31-e6608a6f0022 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:25.938173 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-508b32ec-8e86-4b65-be31-e6608a6f0022 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:26.081842 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-508b32ec-8e86-4b65-be31-e6608a6f0022 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:26.092215 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-508b32ec-8e86-4b65-be31-e6608a6f0022 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:26.093935 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-508b32ec-8e86-4b65-be31-e6608a6f0022 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:26.095268 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-508b32ec-8e86-4b65-be31-e6608a6f0022 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.180756 Jul 27 07:59:26.096401 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 537/1095] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:25 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:27.121501 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2e063df9-948f-4556-9b16-db1ceb5e1098 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:27.122203 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2e063df9-948f-4556-9b16-db1ceb5e1098 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:27.129624 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2e063df9-948f-4556-9b16-db1ceb5e1098 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:27.130029 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2e063df9-948f-4556-9b16-db1ceb5e1098 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:27.130821 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2e063df9-948f-4556-9b16-db1ceb5e1098 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:27.131338 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2e063df9-948f-4556-9b16-db1ceb5e1098 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:27.157578 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=9,nova_cell1:INSERT=6 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:59:27.282159 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2e063df9-948f-4556-9b16-db1ceb5e1098 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:27.290614 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2e063df9-948f-4556-9b16-db1ceb5e1098 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:27.292420 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2e063df9-948f-4556-9b16-db1ceb5e1098 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:27.293621 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2e063df9-948f-4556-9b16-db1ceb5e1098 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.177092 Jul 27 07:59:27.294245 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 559/1096] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:27 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:28.317983 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9c49b89c-b62b-4e68-b8b2-1db24d3edc55 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:28.318646 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-9c49b89c-b62b-4e68-b8b2-1db24d3edc55 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:28.321092 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=40 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:59:28.327084 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9c49b89c-b62b-4e68-b8b2-1db24d3edc55 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:28.327534 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9c49b89c-b62b-4e68-b8b2-1db24d3edc55 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:28.328953 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9c49b89c-b62b-4e68-b8b2-1db24d3edc55 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:28.328953 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9c49b89c-b62b-4e68-b8b2-1db24d3edc55 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:28.475171 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9c49b89c-b62b-4e68-b8b2-1db24d3edc55 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:28.484543 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9c49b89c-b62b-4e68-b8b2-1db24d3edc55 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:28.486068 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9c49b89c-b62b-4e68-b8b2-1db24d3edc55 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:28.487431 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9c49b89c-b62b-4e68-b8b2-1db24d3edc55 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.173753 Jul 27 07:59:28.487995 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 538/1097] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:28 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:29.510312 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9e9ec99a-dee0-4aac-ab55-0eb38dba5abf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:29.510955 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9e9ec99a-dee0-4aac-ab55-0eb38dba5abf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:29.517712 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9e9ec99a-dee0-4aac-ab55-0eb38dba5abf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:29.518400 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9e9ec99a-dee0-4aac-ab55-0eb38dba5abf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:29.519289 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9e9ec99a-dee0-4aac-ab55-0eb38dba5abf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:29.519923 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9e9ec99a-dee0-4aac-ab55-0eb38dba5abf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:29.890715 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9e9ec99a-dee0-4aac-ab55-0eb38dba5abf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:29.902166 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9e9ec99a-dee0-4aac-ab55-0eb38dba5abf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:29.904432 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9e9ec99a-dee0-4aac-ab55-0eb38dba5abf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:29.905916 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9e9ec99a-dee0-4aac-ab55-0eb38dba5abf tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.399712 Jul 27 07:59:29.907320 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 560/1098] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:29 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:30.929446 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-749f5e0a-c437-4bef-91e3-317a3d1c7a26 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:30.930057 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-749f5e0a-c437-4bef-91e3-317a3d1c7a26 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:30.936663 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-749f5e0a-c437-4bef-91e3-317a3d1c7a26 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:30.937115 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-749f5e0a-c437-4bef-91e3-317a3d1c7a26 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:30.937884 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-749f5e0a-c437-4bef-91e3-317a3d1c7a26 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:30.938321 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-749f5e0a-c437-4bef-91e3-317a3d1c7a26 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:31.093918 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-749f5e0a-c437-4bef-91e3-317a3d1c7a26 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:31.103420 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-749f5e0a-c437-4bef-91e3-317a3d1c7a26 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:31.105176 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-749f5e0a-c437-4bef-91e3-317a3d1c7a26 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:31.106525 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-749f5e0a-c437-4bef-91e3-317a3d1c7a26 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.181009 Jul 27 07:59:31.107523 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 539/1099] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:30 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:32.130073 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0ddcab08-8782-4d47-8af5-6bfaff4ed2e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:32.130694 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0ddcab08-8782-4d47-8af5-6bfaff4ed2e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:32.133692 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=36 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:59:32.139131 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0ddcab08-8782-4d47-8af5-6bfaff4ed2e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:32.139583 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0ddcab08-8782-4d47-8af5-6bfaff4ed2e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:32.140355 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0ddcab08-8782-4d47-8af5-6bfaff4ed2e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:32.140793 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0ddcab08-8782-4d47-8af5-6bfaff4ed2e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:32.271685 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0ddcab08-8782-4d47-8af5-6bfaff4ed2e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:32.280815 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0ddcab08-8782-4d47-8af5-6bfaff4ed2e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:32.282385 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0ddcab08-8782-4d47-8af5-6bfaff4ed2e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:32.283633 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0ddcab08-8782-4d47-8af5-6bfaff4ed2e1 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.157401 Jul 27 07:59:32.284133 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 561/1100] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:32 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:33.306652 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-3e720592-053b-442b-bfb2-400913ef1671 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:33.307306 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-3e720592-053b-442b-bfb2-400913ef1671 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:33.314302 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3e720592-053b-442b-bfb2-400913ef1671 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:33.314690 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3e720592-053b-442b-bfb2-400913ef1671 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:33.315497 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3e720592-053b-442b-bfb2-400913ef1671 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:33.316009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3e720592-053b-442b-bfb2-400913ef1671 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:33.525659 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3e720592-053b-442b-bfb2-400913ef1671 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:33.533546 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3e720592-053b-442b-bfb2-400913ef1671 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:33.535093 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3e720592-053b-442b-bfb2-400913ef1671 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:33.536236 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-3e720592-053b-442b-bfb2-400913ef1671 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.233611 Jul 27 07:59:33.536784 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 540/1101] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:33 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:34.559857 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6c9e1997-f355-4043-995b-d63ec6e04a96 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:34.560475 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6c9e1997-f355-4043-995b-d63ec6e04a96 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:34.567151 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6c9e1997-f355-4043-995b-d63ec6e04a96 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:34.567632 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6c9e1997-f355-4043-995b-d63ec6e04a96 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:34.568378 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6c9e1997-f355-4043-995b-d63ec6e04a96 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:34.569489 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6c9e1997-f355-4043-995b-d63ec6e04a96 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:34.700116 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6c9e1997-f355-4043-995b-d63ec6e04a96 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:34.708032 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6c9e1997-f355-4043-995b-d63ec6e04a96 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:34.709518 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6c9e1997-f355-4043-995b-d63ec6e04a96 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:34.710659 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6c9e1997-f355-4043-995b-d63ec6e04a96 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.154725 Jul 27 07:59:34.711247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 562/1102] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:34 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:35.562514 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 07:59:35.563491 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Wed Jul 27 07:59:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 07:59:35.733672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e05ba429-9d95-4396-bf52-e3e6710bc119 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:35.734187 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e05ba429-9d95-4396-bf52-e3e6710bc119 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:35.740859 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e05ba429-9d95-4396-bf52-e3e6710bc119 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:35.741307 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e05ba429-9d95-4396-bf52-e3e6710bc119 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:35.742075 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e05ba429-9d95-4396-bf52-e3e6710bc119 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:35.742506 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e05ba429-9d95-4396-bf52-e3e6710bc119 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:35.886180 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e05ba429-9d95-4396-bf52-e3e6710bc119 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:35.894158 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e05ba429-9d95-4396-bf52-e3e6710bc119 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:35.895708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e05ba429-9d95-4396-bf52-e3e6710bc119 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:35.896868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e05ba429-9d95-4396-bf52-e3e6710bc119 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.167202 Jul 27 07:59:35.897414 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 541/1103] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:35 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:36.920380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-52171173-5fbd-4cec-adad-a3cf5e5aee64 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:36.921189 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-52171173-5fbd-4cec-adad-a3cf5e5aee64 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:36.928458 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-52171173-5fbd-4cec-adad-a3cf5e5aee64 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:36.928992 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-52171173-5fbd-4cec-adad-a3cf5e5aee64 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:36.930042 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-52171173-5fbd-4cec-adad-a3cf5e5aee64 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:36.930706 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-52171173-5fbd-4cec-adad-a3cf5e5aee64 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:37.071762 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-52171173-5fbd-4cec-adad-a3cf5e5aee64 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:37.079724 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-52171173-5fbd-4cec-adad-a3cf5e5aee64 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:37.081228 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-52171173-5fbd-4cec-adad-a3cf5e5aee64 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:37.082428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-52171173-5fbd-4cec-adad-a3cf5e5aee64 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.165977 Jul 27 07:59:37.083007 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 563/1104] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:36 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:38.107065 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a2f383f4-24af-4a57-8c04-fa1edc9c96ce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:38.107903 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a2f383f4-24af-4a57-8c04-fa1edc9c96ce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:38.114555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a2f383f4-24af-4a57-8c04-fa1edc9c96ce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:38.115039 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a2f383f4-24af-4a57-8c04-fa1edc9c96ce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:38.116411 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a2f383f4-24af-4a57-8c04-fa1edc9c96ce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:38.116851 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a2f383f4-24af-4a57-8c04-fa1edc9c96ce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:38.271631 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a2f383f4-24af-4a57-8c04-fa1edc9c96ce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:38.281642 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a2f383f4-24af-4a57-8c04-fa1edc9c96ce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:38.283283 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a2f383f4-24af-4a57-8c04-fa1edc9c96ce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:38.284420 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a2f383f4-24af-4a57-8c04-fa1edc9c96ce tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.181761 Jul 27 07:59:38.291984 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 542/1105] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:38 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:39.308216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-14994b52-ac48-4575-a472-88d28aa1c8a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:39.308787 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-14994b52-ac48-4575-a472-88d28aa1c8a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:39.315174 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14994b52-ac48-4575-a472-88d28aa1c8a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:39.315621 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14994b52-ac48-4575-a472-88d28aa1c8a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:39.316385 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14994b52-ac48-4575-a472-88d28aa1c8a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:39.316824 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-14994b52-ac48-4575-a472-88d28aa1c8a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:39.448719 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-14994b52-ac48-4575-a472-88d28aa1c8a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:39.456694 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-14994b52-ac48-4575-a472-88d28aa1c8a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:39.458207 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-14994b52-ac48-4575-a472-88d28aa1c8a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:39.460081 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-14994b52-ac48-4575-a472-88d28aa1c8a2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.155405 Jul 27 07:59:39.460677 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 564/1106] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:39 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:40.483737 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1e09b470-ece8-4bc5-810a-21d834e9464c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:40.484336 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-1e09b470-ece8-4bc5-810a-21d834e9464c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:40.491332 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1e09b470-ece8-4bc5-810a-21d834e9464c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:40.491786 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1e09b470-ece8-4bc5-810a-21d834e9464c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:40.492560 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1e09b470-ece8-4bc5-810a-21d834e9464c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:40.493002 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-1e09b470-ece8-4bc5-810a-21d834e9464c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:40.625410 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1e09b470-ece8-4bc5-810a-21d834e9464c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:40.634305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1e09b470-ece8-4bc5-810a-21d834e9464c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:40.635888 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-1e09b470-ece8-4bc5-810a-21d834e9464c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:40.637055 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1e09b470-ece8-4bc5-810a-21d834e9464c tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.157265 Jul 27 07:59:40.637650 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 543/1107] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:40 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:41.660246 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9a7d0cf2-6192-4792-bf15-f8bde85a6ab7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:41.660851 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9a7d0cf2-6192-4792-bf15-f8bde85a6ab7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:41.667504 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9a7d0cf2-6192-4792-bf15-f8bde85a6ab7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:41.667944 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9a7d0cf2-6192-4792-bf15-f8bde85a6ab7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:41.668714 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9a7d0cf2-6192-4792-bf15-f8bde85a6ab7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:41.669145 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9a7d0cf2-6192-4792-bf15-f8bde85a6ab7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:41.805815 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9a7d0cf2-6192-4792-bf15-f8bde85a6ab7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:41.813861 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9a7d0cf2-6192-4792-bf15-f8bde85a6ab7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:41.815421 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9a7d0cf2-6192-4792-bf15-f8bde85a6ab7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:41.816587 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9a7d0cf2-6192-4792-bf15-f8bde85a6ab7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.160231 Jul 27 07:59:41.817179 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 565/1108] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:41 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:42.840520 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-441942e4-1b50-4703-8d4e-4cb3db96395d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:42.841408 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-441942e4-1b50-4703-8d4e-4cb3db96395d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:42.848949 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-441942e4-1b50-4703-8d4e-4cb3db96395d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:42.849327 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-441942e4-1b50-4703-8d4e-4cb3db96395d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:42.850762 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-441942e4-1b50-4703-8d4e-4cb3db96395d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:42.851328 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-441942e4-1b50-4703-8d4e-4cb3db96395d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:42.980862 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-441942e4-1b50-4703-8d4e-4cb3db96395d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:42.990265 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-441942e4-1b50-4703-8d4e-4cb3db96395d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:42.991844 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-441942e4-1b50-4703-8d4e-4cb3db96395d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:42.993036 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-441942e4-1b50-4703-8d4e-4cb3db96395d tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.156446 Jul 27 07:59:42.993854 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 544/1109] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:42 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:44.018382 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fe65d799-89e0-4840-bd6d-7e7c96fd1306 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:44.019047 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fe65d799-89e0-4840-bd6d-7e7c96fd1306 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:44.025538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fe65d799-89e0-4840-bd6d-7e7c96fd1306 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:44.025982 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fe65d799-89e0-4840-bd6d-7e7c96fd1306 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:44.026740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fe65d799-89e0-4840-bd6d-7e7c96fd1306 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:44.027200 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fe65d799-89e0-4840-bd6d-7e7c96fd1306 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:44.154512 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fe65d799-89e0-4840-bd6d-7e7c96fd1306 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:44.163215 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fe65d799-89e0-4840-bd6d-7e7c96fd1306 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:44.164740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fe65d799-89e0-4840-bd6d-7e7c96fd1306 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:44.165900 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fe65d799-89e0-4840-bd6d-7e7c96fd1306 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.151489 Jul 27 07:59:44.166465 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 566/1110] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:44 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:45.057492 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-6b719dbd-ba4e-493f-8dd7-4ca28332d545 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1000241690", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-506878589", "security_groups": [{"name": "tempest-secgroup-smoke-844798545"}], "block_device_mapping_v2": [{"uuid": "ce0d1d75-3011-47dd-9235-4268f480d362", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6f4c8516-f20c-40ca-8fd7-7c9a143ac3f6"}]}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:59:45.171744 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.network.neutron [None req-6b719dbd-ba4e-493f-8dd7-4ca28332d545 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] validate_networks() for [('6f4c8516-f20c-40ca-8fd7-7c9a143ac3f6', None, None, None, None, None)] {{(pid=117779) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 07:59:45.187575 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7c86dce7-835d-49e8-b904-2446d74dd0c2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:45.188188 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7c86dce7-835d-49e8-b904-2446d74dd0c2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:45.195267 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7c86dce7-835d-49e8-b904-2446d74dd0c2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:45.195720 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7c86dce7-835d-49e8-b904-2446d74dd0c2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:45.196490 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7c86dce7-835d-49e8-b904-2446d74dd0c2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:45.197733 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7c86dce7-835d-49e8-b904-2446d74dd0c2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:45.342040 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7c86dce7-835d-49e8-b904-2446d74dd0c2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:45.350847 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7c86dce7-835d-49e8-b904-2446d74dd0c2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:45.352410 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7c86dce7-835d-49e8-b904-2446d74dd0c2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:45.353598 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7c86dce7-835d-49e8-b904-2446d74dd0c2 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.169872 Jul 27 07:59:45.367608 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 567/1111] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:45 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 07:59:45.596987 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-6b719dbd-ba4e-493f-8dd7-4ca28332d545 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Flavor limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 07:59:45.597417 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-6b719dbd-ba4e-493f-8dd7-4ca28332d545 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Image limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 07:59:45.597894 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-6b719dbd-ba4e-493f-8dd7-4ca28332d545 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Flavor pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 07:59:45.598329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-6b719dbd-ba4e-493f-8dd7-4ca28332d545 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Image pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 07:59:45.598735 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-6b719dbd-ba4e-493f-8dd7-4ca28332d545 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 07:59:45.607506 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6b719dbd-ba4e-493f-8dd7-4ca28332d545 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:45.607945 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6b719dbd-ba4e-493f-8dd7-4ca28332d545 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:45.608732 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6b719dbd-ba4e-493f-8dd7-4ca28332d545 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:45.609178 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6b719dbd-ba4e-493f-8dd7-4ca28332d545 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:45.625917 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-6b719dbd-ba4e-493f-8dd7-4ca28332d545 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Getting quotas for project 479f452a345b4c219d32d2ad78183af6. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 07:59:45.630430 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-6b719dbd-ba4e-493f-8dd7-4ca28332d545 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Getting quotas for user 5efb3ea424f8450c883d4757545af18d and project 479f452a345b4c219d32d2ad78183af6. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 07:59:45.687062 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-6b719dbd-ba4e-493f-8dd7-4ca28332d545 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Going to run 1 instances... {{(pid=117779) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 07:59:45.689151 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-6b719dbd-ba4e-493f-8dd7-4ca28332d545 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce0d1d75-3011-47dd-9235-4268f480d362',volume_size=None,volume_type=None)] {{(pid=117779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 07:59:45.820843 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-6b719dbd-ba4e-493f-8dd7-4ca28332d545 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.767488 Jul 27 07:59:45.821482 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 545/1112] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 07:59:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 07:59:45.832293 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ee8d4799-52ba-4a48-ad36-84940c37d437 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:45.832903 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ee8d4799-52ba-4a48-ad36-84940c37d437 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:45.886249 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ee8d4799-52ba-4a48-ad36-84940c37d437 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:45.893000 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ee8d4799-52ba-4a48-ad36-84940c37d437 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1094 microversion: 2.1 time: 0.064551 Jul 27 07:59:45.893563 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 568/1113] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:59:45 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:59:46.383354 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-031e9b56-760c-4586-bce7-28e426d9e194 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:46.384576 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-031e9b56-760c-4586-bce7-28e426d9e194 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:46.393311 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-031e9b56-760c-4586-bce7-28e426d9e194 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:46.393916 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-031e9b56-760c-4586-bce7-28e426d9e194 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:46.394817 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-031e9b56-760c-4586-bce7-28e426d9e194 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:46.395399 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-031e9b56-760c-4586-bce7-28e426d9e194 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:46.575659 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-031e9b56-760c-4586-bce7-28e426d9e194 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:46.585092 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-031e9b56-760c-4586-bce7-28e426d9e194 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:46.586715 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-031e9b56-760c-4586-bce7-28e426d9e194 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:46.588128 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-031e9b56-760c-4586-bce7-28e426d9e194 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.211916 Jul 27 07:59:46.588675 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 546/1114] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:46 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:46.596212 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ebd1498a-e011-495a-9ca0-8041b820ce5d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:46.598603 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ebd1498a-e011-495a-9ca0-8041b820ce5d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:46.606768 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ebd1498a-e011-495a-9ca0-8041b820ce5d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:46.607264 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ebd1498a-e011-495a-9ca0-8041b820ce5d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:46.608047 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ebd1498a-e011-495a-9ca0-8041b820ce5d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:46.608490 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ebd1498a-e011-495a-9ca0-8041b820ce5d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:46.642295 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ebd1498a-e011-495a-9ca0-8041b820ce5d tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054893 Jul 27 07:59:46.642774 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 569/1115] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:59:46 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:59:46.802692 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-bae11dde-4fc7-4b67-aecf-6739dfc78dc8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:46.803507 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-bae11dde-4fc7-4b67-aecf-6739dfc78dc8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:46.810194 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bae11dde-4fc7-4b67-aecf-6739dfc78dc8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:46.811003 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bae11dde-4fc7-4b67-aecf-6739dfc78dc8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:46.812169 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bae11dde-4fc7-4b67-aecf-6739dfc78dc8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:46.812620 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bae11dde-4fc7-4b67-aecf-6739dfc78dc8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:46.845926 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-bae11dde-4fc7-4b67-aecf-6739dfc78dc8 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments/19e7c77d-1c67-4c5d-b221-09b10f7e0855" status: 200 len: 194 microversion: 2.1 time: 0.046986 Jul 27 07:59:46.846830 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 547/1116] 10.222.0.18 () {58 vars in 1413 bytes} [Wed Jul 27 07:59:46 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments/19e7c77d-1c67-4c5d-b221-09b10f7e0855 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:59:46.858549 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f9065ac1-e992-4405-b03b-763980eab834 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:46.859327 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f9065ac1-e992-4405-b03b-763980eab834 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:46.867114 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f9065ac1-e992-4405-b03b-763980eab834 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:46.867909 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f9065ac1-e992-4405-b03b-763980eab834 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:46.868926 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f9065ac1-e992-4405-b03b-763980eab834 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:46.869588 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f9065ac1-e992-4405-b03b-763980eab834 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:46.901439 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-678dc102-ff8d-4ed1-9e74-4ec252b82c58 req-ae18bc34-30bb-4cb1-9bc7-f1560f12486c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2", "name": "network-vif-plugged", "status": "completed", "tag": "19f48487-6051-4c27-9a27-015b3b0d174a"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:59:46.923605 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-678dc102-ff8d-4ed1-9e74-4ec252b82c58 req-ae18bc34-30bb-4cb1-9bc7-f1560f12486c service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:46.924633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-678dc102-ff8d-4ed1-9e74-4ec252b82c58 req-ae18bc34-30bb-4cb1-9bc7-f1560f12486c service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:46.939726 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-678dc102-ff8d-4ed1-9e74-4ec252b82c58 req-ae18bc34-30bb-4cb1-9bc7-f1560f12486c service nova] Creating event network-vif-plugged:19f48487-6051-4c27-9a27-015b3b0d174a for instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 on hv-cinder-82549 Jul 27 07:59:46.947009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-678dc102-ff8d-4ed1-9e74-4ec252b82c58 req-ae18bc34-30bb-4cb1-9bc7-f1560f12486c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049918 Jul 27 07:59:46.958572 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 548/1117] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:59:46.965971 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-13a6f3fc-2e36-40dc-9e68-4cc77916be32 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:46.967747 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-13a6f3fc-2e36-40dc-9e68-4cc77916be32 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:46.977356 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-13a6f3fc-2e36-40dc-9e68-4cc77916be32 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:46.978496 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-13a6f3fc-2e36-40dc-9e68-4cc77916be32 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:46.979926 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-13a6f3fc-2e36-40dc-9e68-4cc77916be32 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:46.980690 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-13a6f3fc-2e36-40dc-9e68-4cc77916be32 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:46.994482 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-f9065ac1-e992-4405-b03b-763980eab834 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lazy-loading 'services' on Instance uuid 57b781f2-0fd1-4873-9236-e01b979ce080 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:59:47.072933 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-13a6f3fc-2e36-40dc-9e68-4cc77916be32 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:47.082646 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-13a6f3fc-2e36-40dc-9e68-4cc77916be32 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1200 microversion: 2.1 time: 0.122476 Jul 27 07:59:47.097601 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 549/1118] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:59:46 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1200 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:59:47.150251 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f9065ac1-e992-4405-b03b-763980eab834 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "DELETE /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments/19e7c77d-1c67-4c5d-b221-09b10f7e0855" status: 202 len: 0 microversion: 2.1 time: 0.296676 Jul 27 07:59:47.150840 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 570/1119] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Jul 27 07:59:46 2022] DELETE /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments/19e7c77d-1c67-4c5d-b221-09b10f7e0855 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 07:59:47.612086 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b60c7317-a8e2-419a-9d6c-fcb9535e6ea3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:47.612687 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b60c7317-a8e2-419a-9d6c-fcb9535e6ea3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:47.619959 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b60c7317-a8e2-419a-9d6c-fcb9535e6ea3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:47.620408 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b60c7317-a8e2-419a-9d6c-fcb9535e6ea3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:47.621188 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b60c7317-a8e2-419a-9d6c-fcb9535e6ea3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:47.621623 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b60c7317-a8e2-419a-9d6c-fcb9535e6ea3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:47.809792 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b60c7317-a8e2-419a-9d6c-fcb9535e6ea3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:47.819102 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b60c7317-a8e2-419a-9d6c-fcb9535e6ea3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:47.820642 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b60c7317-a8e2-419a-9d6c-fcb9535e6ea3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:47.821880 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b60c7317-a8e2-419a-9d6c-fcb9535e6ea3 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.213823 Jul 27 07:59:47.822445 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 550/1120] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:47 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:48.107189 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fdc4a9a6-b91f-43de-addd-76c8c18af898 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:48.107971 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fdc4a9a6-b91f-43de-addd-76c8c18af898 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:48.114513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fdc4a9a6-b91f-43de-addd-76c8c18af898 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:48.115529 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fdc4a9a6-b91f-43de-addd-76c8c18af898 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:48.116351 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fdc4a9a6-b91f-43de-addd-76c8c18af898 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:48.116793 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fdc4a9a6-b91f-43de-addd-76c8c18af898 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:48.258738 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fdc4a9a6-b91f-43de-addd-76c8c18af898 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:48.267249 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fdc4a9a6-b91f-43de-addd-76c8c18af898 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1277 microversion: 2.1 time: 0.165498 Jul 27 07:59:48.267839 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 571/1121] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:59:48 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:59:48.848341 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a30c36d0-4d4f-44f9-935b-85ab5df8ab04 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:48.848958 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a30c36d0-4d4f-44f9-935b-85ab5df8ab04 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:48.856124 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a30c36d0-4d4f-44f9-935b-85ab5df8ab04 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:48.856855 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a30c36d0-4d4f-44f9-935b-85ab5df8ab04 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:48.857630 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a30c36d0-4d4f-44f9-935b-85ab5df8ab04 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:48.858059 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a30c36d0-4d4f-44f9-935b-85ab5df8ab04 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:49.072611 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a30c36d0-4d4f-44f9-935b-85ab5df8ab04 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:49.081832 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a30c36d0-4d4f-44f9-935b-85ab5df8ab04 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:49.083995 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-a30c36d0-4d4f-44f9-935b-85ab5df8ab04 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:49.085650 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a30c36d0-4d4f-44f9-935b-85ab5df8ab04 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.243014 Jul 27 07:59:49.099788 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 551/1122] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:48 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:49.136207 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-c1a7b509-5546-4b18-a2cd-b60dc0500bce req-7113dda2-d3b6-494a-8e1e-8c9efd525d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b810b7-1fa3-47ca-865e-d3ed7e912d52", "tag": "ec4aad5b-6031-47bc-8942-ce881969099d"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:59:49.146532 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-c1a7b509-5546-4b18-a2cd-b60dc0500bce req-7113dda2-d3b6-494a-8e1e-8c9efd525d7a service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:49.146999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-c1a7b509-5546-4b18-a2cd-b60dc0500bce req-7113dda2-d3b6-494a-8e1e-8c9efd525d7a service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:49.164723 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-c1a7b509-5546-4b18-a2cd-b60dc0500bce req-7113dda2-d3b6-494a-8e1e-8c9efd525d7a service nova] Creating event network-changed:ec4aad5b-6031-47bc-8942-ce881969099d for instance 97b810b7-1fa3-47ca-865e-d3ed7e912d52 on hv-cinder-82549 Jul 27 07:59:49.169898 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-c1a7b509-5546-4b18-a2cd-b60dc0500bce req-7113dda2-d3b6-494a-8e1e-8c9efd525d7a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037413 Jul 27 07:59:49.170503 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 572/1123] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:59:49.290257 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e4539fc4-25dc-480d-8a82-9af595d54f64 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:49.291126 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e4539fc4-25dc-480d-8a82-9af595d54f64 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:49.297300 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e4539fc4-25dc-480d-8a82-9af595d54f64 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:49.297742 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e4539fc4-25dc-480d-8a82-9af595d54f64 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:49.298499 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e4539fc4-25dc-480d-8a82-9af595d54f64 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:49.298946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e4539fc4-25dc-480d-8a82-9af595d54f64 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:49.457444 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e4539fc4-25dc-480d-8a82-9af595d54f64 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:49.465518 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e4539fc4-25dc-480d-8a82-9af595d54f64 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1277 microversion: 2.1 time: 0.179773 Jul 27 07:59:49.466071 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 552/1124] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:59:49 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:59:50.110223 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-98ba5031-c1aa-4a3f-8bf6-efdcd0a00814 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:50.110937 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-98ba5031-c1aa-4a3f-8bf6-efdcd0a00814 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:50.119562 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-98ba5031-c1aa-4a3f-8bf6-efdcd0a00814 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:50.120012 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-98ba5031-c1aa-4a3f-8bf6-efdcd0a00814 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:50.120948 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-98ba5031-c1aa-4a3f-8bf6-efdcd0a00814 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:50.121379 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-98ba5031-c1aa-4a3f-8bf6-efdcd0a00814 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:50.258858 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-98ba5031-c1aa-4a3f-8bf6-efdcd0a00814 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:50.268010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-98ba5031-c1aa-4a3f-8bf6-efdcd0a00814 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:50.269615 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-98ba5031-c1aa-4a3f-8bf6-efdcd0a00814 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:50.271171 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-98ba5031-c1aa-4a3f-8bf6-efdcd0a00814 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1732 microversion: 2.20 time: 0.165014 Jul 27 07:59:50.272126 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 573/1125] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:50 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:50.487867 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e982baf4-acb0-4b0f-b487-c954e01c7355 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:50.488644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e982baf4-acb0-4b0f-b487-c954e01c7355 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:50.496604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e982baf4-acb0-4b0f-b487-c954e01c7355 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:50.497246 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e982baf4-acb0-4b0f-b487-c954e01c7355 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:50.497875 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e982baf4-acb0-4b0f-b487-c954e01c7355 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:50.498395 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e982baf4-acb0-4b0f-b487-c954e01c7355 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:50.502923 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=100 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:59:50.648473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e982baf4-acb0-4b0f-b487-c954e01c7355 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:50.655912 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e982baf4-acb0-4b0f-b487-c954e01c7355 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1265 microversion: 2.1 time: 0.172725 Jul 27 07:59:50.656471 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 553/1126] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:59:50 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:59:51.294177 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d2b3cc8d-db4c-4a4e-b5ba-b9eb03d58d29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:51.294809 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d2b3cc8d-db4c-4a4e-b5ba-b9eb03d58d29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:51.302054 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d2b3cc8d-db4c-4a4e-b5ba-b9eb03d58d29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:51.302495 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d2b3cc8d-db4c-4a4e-b5ba-b9eb03d58d29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:51.303290 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d2b3cc8d-db4c-4a4e-b5ba-b9eb03d58d29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:51.303814 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d2b3cc8d-db4c-4a4e-b5ba-b9eb03d58d29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:51.446410 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d2b3cc8d-db4c-4a4e-b5ba-b9eb03d58d29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:51.458334 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d2b3cc8d-db4c-4a4e-b5ba-b9eb03d58d29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:51.462655 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d2b3cc8d-db4c-4a4e-b5ba-b9eb03d58d29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:51.467085 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d2b3cc8d-db4c-4a4e-b5ba-b9eb03d58d29 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1719 microversion: 2.20 time: 0.176822 Jul 27 07:59:51.468428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 574/1127] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 07:59:51 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 07:59:51.501930 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-227a7c34-c056-4f91-aae8-60dfd7cb0562 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:51.502511 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-227a7c34-c056-4f91-aae8-60dfd7cb0562 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:51.509740 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-227a7c34-c056-4f91-aae8-60dfd7cb0562 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:51.510276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-227a7c34-c056-4f91-aae8-60dfd7cb0562 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:51.511150 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-227a7c34-c056-4f91-aae8-60dfd7cb0562 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:51.511679 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-227a7c34-c056-4f91-aae8-60dfd7cb0562 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:51.541068 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-227a7c34-c056-4f91-aae8-60dfd7cb0562 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments/7447b848-8c10-421c-b4b8-22f84a7fa84d" status: 200 len: 194 microversion: 2.1 time: 0.043199 Jul 27 07:59:51.541675 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 554/1128] 10.222.0.18 () {58 vars in 1413 bytes} [Wed Jul 27 07:59:51 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments/7447b848-8c10-421c-b4b8-22f84a7fa84d => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 07:59:51.552805 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7dc48e20-adca-4b87-a929-ac3c3915c628 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:51.553301 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7dc48e20-adca-4b87-a929-ac3c3915c628 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:51.559222 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7dc48e20-adca-4b87-a929-ac3c3915c628 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:51.559666 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7dc48e20-adca-4b87-a929-ac3c3915c628 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:51.560426 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7dc48e20-adca-4b87-a929-ac3c3915c628 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:51.560857 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7dc48e20-adca-4b87-a929-ac3c3915c628 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:51.642455 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-7dc48e20-adca-4b87-a929-ac3c3915c628 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lazy-loading 'services' on Instance uuid 57b781f2-0fd1-4873-9236-e01b979ce080 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:59:51.678135 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-56f45d0f-afe8-4d72-ab70-b361d45784e0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:51.679163 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-56f45d0f-afe8-4d72-ab70-b361d45784e0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:51.685690 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-56f45d0f-afe8-4d72-ab70-b361d45784e0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:51.686140 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-56f45d0f-afe8-4d72-ab70-b361d45784e0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:51.686937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-56f45d0f-afe8-4d72-ab70-b361d45784e0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:51.687377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-56f45d0f-afe8-4d72-ab70-b361d45784e0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:51.716358 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7dc48e20-adca-4b87-a929-ac3c3915c628 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "DELETE /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments/7447b848-8c10-421c-b4b8-22f84a7fa84d" status: 202 len: 0 microversion: 2.1 time: 0.167603 Jul 27 07:59:51.717244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 575/1129] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Jul 27 07:59:51 2022] DELETE /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments/7447b848-8c10-421c-b4b8-22f84a7fa84d => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 07:59:51.885892 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-56f45d0f-afe8-4d72-ab70-b361d45784e0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:51.894134 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-56f45d0f-afe8-4d72-ab70-b361d45784e0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1265 microversion: 2.1 time: 0.220331 Jul 27 07:59:51.894625 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 555/1130] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:59:51 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 07:59:52.917332 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-dc631c75-6821-43b8-bd32-f82dfbcf8401 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:52.918121 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-dc631c75-6821-43b8-bd32-f82dfbcf8401 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:52.924842 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dc631c75-6821-43b8-bd32-f82dfbcf8401 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:52.925381 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dc631c75-6821-43b8-bd32-f82dfbcf8401 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:52.926225 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dc631c75-6821-43b8-bd32-f82dfbcf8401 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:52.926664 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dc631c75-6821-43b8-bd32-f82dfbcf8401 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:52.943938 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:59:53.061001 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-dc631c75-6821-43b8-bd32-f82dfbcf8401 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:53.068898 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-dc631c75-6821-43b8-bd32-f82dfbcf8401 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1265 microversion: 2.1 time: 0.156894 Jul 27 07:59:53.069465 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 576/1131] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:59:52 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:59:53.962660 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-5e235454-17af-44e8-a3c1-1615ee51b766 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:53.964984 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-5e235454-17af-44e8-a3c1-1615ee51b766 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:53.971845 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5e235454-17af-44e8-a3c1-1615ee51b766 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:53.972233 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5e235454-17af-44e8-a3c1-1615ee51b766 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:53.973006 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5e235454-17af-44e8-a3c1-1615ee51b766 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:53.973441 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5e235454-17af-44e8-a3c1-1615ee51b766 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:54.002393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-5e235454-17af-44e8-a3c1-1615ee51b766 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043895 Jul 27 07:59:54.002974 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 556/1132] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:59:53 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 07:59:54.089885 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-043b1237-14b2-4bfa-b4f5-3023b91713b6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:54.090498 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-043b1237-14b2-4bfa-b4f5-3023b91713b6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:54.097345 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-043b1237-14b2-4bfa-b4f5-3023b91713b6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:54.097889 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-043b1237-14b2-4bfa-b4f5-3023b91713b6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:54.098644 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-043b1237-14b2-4bfa-b4f5-3023b91713b6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:54.098998 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-043b1237-14b2-4bfa-b4f5-3023b91713b6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:54.118158 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-916b19b0-9fc1-4124-a45e-125fdb2881b4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:54.120401 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-916b19b0-9fc1-4124-a45e-125fdb2881b4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:54.126472 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-916b19b0-9fc1-4124-a45e-125fdb2881b4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:54.126955 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-916b19b0-9fc1-4124-a45e-125fdb2881b4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:54.127727 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-916b19b0-9fc1-4124-a45e-125fdb2881b4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:54.128163 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-916b19b0-9fc1-4124-a45e-125fdb2881b4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:54.157948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-916b19b0-9fc1-4124-a45e-125fdb2881b4 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045013 Jul 27 07:59:54.158516 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 557/1133] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 07:59:54 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 07:59:54.221715 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c72a0332-73cd-41ee-85bd-33c14044a7c0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:54.222303 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c72a0332-73cd-41ee-85bd-33c14044a7c0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:54.228857 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c72a0332-73cd-41ee-85bd-33c14044a7c0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:54.229308 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c72a0332-73cd-41ee-85bd-33c14044a7c0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:54.230076 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c72a0332-73cd-41ee-85bd-33c14044a7c0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:54.230513 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c72a0332-73cd-41ee-85bd-33c14044a7c0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:54.236249 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-043b1237-14b2-4bfa-b4f5-3023b91713b6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:54.244404 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-043b1237-14b2-4bfa-b4f5-3023b91713b6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1265 microversion: 2.1 time: 0.158323 Jul 27 07:59:54.244980 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 577/1134] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:59:54 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:59:54.256976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c72a0332-73cd-41ee-85bd-33c14044a7c0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Going to try to terminate instance {{(pid=117779) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 07:59:54.334421 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c72a0332-73cd-41ee-85bd-33c14044a7c0 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "DELETE /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 204 len: 0 microversion: 2.1 time: 0.116435 Jul 27 07:59:54.335244 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 558/1135] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 07:59:54 2022] DELETE /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 07:59:54.344309 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3c115457-cbde-4a56-ad7b-6a5127686f71 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:54.344926 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3c115457-cbde-4a56-ad7b-6a5127686f71 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:54.352006 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3c115457-cbde-4a56-ad7b-6a5127686f71 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:54.352453 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3c115457-cbde-4a56-ad7b-6a5127686f71 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:54.353218 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3c115457-cbde-4a56-ad7b-6a5127686f71 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:54.353653 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3c115457-cbde-4a56-ad7b-6a5127686f71 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:54.482465 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3c115457-cbde-4a56-ad7b-6a5127686f71 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:54.490579 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3c115457-cbde-4a56-ad7b-6a5127686f71 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 200 len: 1671 microversion: 2.1 time: 0.149590 Jul 27 07:59:54.491177 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 578/1136] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:59:54 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:59:55.265784 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2bd1298b-88cb-4e26-a877-ad6032d9940f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:55.266515 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2bd1298b-88cb-4e26-a877-ad6032d9940f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:55.273770 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2bd1298b-88cb-4e26-a877-ad6032d9940f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:55.274215 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2bd1298b-88cb-4e26-a877-ad6032d9940f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:55.275005 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2bd1298b-88cb-4e26-a877-ad6032d9940f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:55.275443 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2bd1298b-88cb-4e26-a877-ad6032d9940f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:55.405547 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2bd1298b-88cb-4e26-a877-ad6032d9940f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:55.413031 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2bd1298b-88cb-4e26-a877-ad6032d9940f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1265 microversion: 2.1 time: 0.151511 Jul 27 07:59:55.413593 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 559/1137] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:59:55 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:59:55.512846 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b4e97052-1d27-47cb-b5ca-ddb3d3d96b9a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:55.513515 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b4e97052-1d27-47cb-b5ca-ddb3d3d96b9a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:55.520493 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b4e97052-1d27-47cb-b5ca-ddb3d3d96b9a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:55.520956 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b4e97052-1d27-47cb-b5ca-ddb3d3d96b9a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:55.521729 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b4e97052-1d27-47cb-b5ca-ddb3d3d96b9a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:55.522166 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b4e97052-1d27-47cb-b5ca-ddb3d3d96b9a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:55.660713 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b4e97052-1d27-47cb-b5ca-ddb3d3d96b9a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:55.669251 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b4e97052-1d27-47cb-b5ca-ddb3d3d96b9a tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 200 len: 1671 microversion: 2.1 time: 0.160586 Jul 27 07:59:55.669818 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 579/1138] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:59:55 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:59:56.444409 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-00b1e807-dd9c-46b1-831a-4ecf093bfe2c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:56.445019 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-00b1e807-dd9c-46b1-831a-4ecf093bfe2c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:56.446995 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=2 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:59:56.447645 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=6 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:59:56.454172 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-00b1e807-dd9c-46b1-831a-4ecf093bfe2c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:56.454615 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-00b1e807-dd9c-46b1-831a-4ecf093bfe2c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:56.455436 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-00b1e807-dd9c-46b1-831a-4ecf093bfe2c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:56.455868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-00b1e807-dd9c-46b1-831a-4ecf093bfe2c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:56.587921 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-00b1e807-dd9c-46b1-831a-4ecf093bfe2c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:56.595860 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-00b1e807-dd9c-46b1-831a-4ecf093bfe2c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1265 microversion: 2.1 time: 0.155832 Jul 27 07:59:56.596426 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 560/1139] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:59:56 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:59:56.690769 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3c927ec8-a255-4f61-9a5a-d1ee03ad532c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:56.691426 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3c927ec8-a255-4f61-9a5a-d1ee03ad532c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:56.693653 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:59:56.699879 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3c927ec8-a255-4f61-9a5a-d1ee03ad532c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:56.700331 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3c927ec8-a255-4f61-9a5a-d1ee03ad532c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:56.701114 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3c927ec8-a255-4f61-9a5a-d1ee03ad532c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:56.701562 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3c927ec8-a255-4f61-9a5a-d1ee03ad532c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:56.834268 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3c927ec8-a255-4f61-9a5a-d1ee03ad532c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:56.841925 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3c927ec8-a255-4f61-9a5a-d1ee03ad532c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 200 len: 1671 microversion: 2.1 time: 0.155386 Jul 27 07:59:56.842460 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 580/1140] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:59:56 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:59:57.536078 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-41758661-2e8e-49bc-8e68-54dbc3ca30bb req-ca7f0c50-2bf6-40f2-8586-b2e3f8e418c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b781f2-0fd1-4873-9236-e01b979ce080", "name": "network-vif-deleted", "tag": "fa40185e-3939-4e43-9d50-057280d094bd"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 07:59:57.546266 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-41758661-2e8e-49bc-8e68-54dbc3ca30bb req-ca7f0c50-2bf6-40f2-8586-b2e3f8e418c8 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:57.546709 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-41758661-2e8e-49bc-8e68-54dbc3ca30bb req-ca7f0c50-2bf6-40f2-8586-b2e3f8e418c8 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:57.558856 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-41758661-2e8e-49bc-8e68-54dbc3ca30bb req-ca7f0c50-2bf6-40f2-8586-b2e3f8e418c8 service nova] Creating event network-vif-deleted:fa40185e-3939-4e43-9d50-057280d094bd for instance 57b781f2-0fd1-4873-9236-e01b979ce080 on hv-cinder-82549 Jul 27 07:59:57.565302 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-41758661-2e8e-49bc-8e68-54dbc3ca30bb req-ca7f0c50-2bf6-40f2-8586-b2e3f8e418c8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032992 Jul 27 07:59:57.566249 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 561/1141] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 07:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 07:59:57.618180 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-dc95cf79-83a3-478c-95fc-bffbb47497b6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:57.618735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-dc95cf79-83a3-478c-95fc-bffbb47497b6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:57.626182 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dc95cf79-83a3-478c-95fc-bffbb47497b6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:57.627281 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dc95cf79-83a3-478c-95fc-bffbb47497b6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:57.628087 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dc95cf79-83a3-478c-95fc-bffbb47497b6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:57.628533 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dc95cf79-83a3-478c-95fc-bffbb47497b6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:57.782125 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-dc95cf79-83a3-478c-95fc-bffbb47497b6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:57.790373 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-dc95cf79-83a3-478c-95fc-bffbb47497b6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1265 microversion: 2.1 time: 0.177004 Jul 27 07:59:57.790981 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 581/1142] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:59:57 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:59:57.871054 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-51d8786d-1dc5-4dca-ba6c-e74f7e252048 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:57.871797 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-51d8786d-1dc5-4dca-ba6c-e74f7e252048 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:57.881455 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-51d8786d-1dc5-4dca-ba6c-e74f7e252048 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:57.882004 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-51d8786d-1dc5-4dca-ba6c-e74f7e252048 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:57.882807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-51d8786d-1dc5-4dca-ba6c-e74f7e252048 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:57.883285 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-51d8786d-1dc5-4dca-ba6c-e74f7e252048 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:57.918458 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-51d8786d-1dc5-4dca-ba6c-e74f7e252048 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:57.918925 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-51d8786d-1dc5-4dca-ba6c-e74f7e252048 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:57.919383 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.objects.instance [None req-51d8786d-1dc5-4dca-ba6c-e74f7e252048 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lazy-loading 'fault' on Instance uuid 57b781f2-0fd1-4873-9236-e01b979ce080 {{(pid=117779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 07:59:57.961559 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-51d8786d-1dc5-4dca-ba6c-e74f7e252048 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a5b392d9d44859110f048bea7331b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e9fffbb5c6457ca3bc45c6226230a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:57.969614 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-51d8786d-1dc5-4dca-ba6c-e74f7e252048 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 200 len: 1327 microversion: 2.1 time: 0.102883 Jul 27 07:59:57.970202 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 562/1143] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:59:57 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:59:58.812021 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-49017700-d824-40aa-9370-f7ea128b9d9a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:58.812636 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-49017700-d824-40aa-9370-f7ea128b9d9a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:58.819971 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-49017700-d824-40aa-9370-f7ea128b9d9a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:58.820425 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-49017700-d824-40aa-9370-f7ea128b9d9a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:58.821207 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-49017700-d824-40aa-9370-f7ea128b9d9a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:58.821646 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-49017700-d824-40aa-9370-f7ea128b9d9a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:58.960991 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-49017700-d824-40aa-9370-f7ea128b9d9a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 07:59:58.968413 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-49017700-d824-40aa-9370-f7ea128b9d9a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1265 microversion: 2.1 time: 0.160336 Jul 27 07:59:58.968976 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 582/1144] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:59:58 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 07:59:58.990634 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-939972e3-61ac-49d9-b51a-a05c3988e755 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:58.991283 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-939972e3-61ac-49d9-b51a-a05c3988e755 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:58.993829 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 07:59:58.999203 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-939972e3-61ac-49d9-b51a-a05c3988e755 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:58.999648 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-939972e3-61ac-49d9-b51a-a05c3988e755 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:59.000420 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-939972e3-61ac-49d9-b51a-a05c3988e755 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:59.000856 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-939972e3-61ac-49d9-b51a-a05c3988e755 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:59.016565 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-939972e3-61ac-49d9-b51a-a05c3988e755 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] HTTP exception thrown: Instance 57b781f2-0fd1-4873-9236-e01b979ce080 could not be found. Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-939972e3-61ac-49d9-b51a-a05c3988e755 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Request method failure captured: Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 HTTP/1.1 Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O4OfPW-7ey2k6RWU-0v9cfXiXmuAJlvO5rk6pXP6-tSwUKoNK4aQm5qpWjXsuip_TKJKni_cb3HJC33b2C7rf8_dh1s6W6GH-eaApeWoHTsOSp7nbaSQymngYGN5G-4LyzHS_pDjg5-EA8ic1y_1V5sicu9dlRAj0WWm10ix3_R9Mk Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 88e9fffbb5c6457ca3bc45c6226230a3 Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-AttachVolumeTestJSON-195669691 Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 07:59:59.018191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 07:59:59.019890 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 07:59:59.019890 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-AttachVolumeTestJSON-195669691 Jul 27 07:59:59.019890 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 88e9fffbb5c6457ca3bc45c6226230a3 Jul 27 07:59:59.019890 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-AttachVolumeTestJSON-195669691 Jul 27 07:59:59.019890 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-AttachVolumeTestJSON-195669691-project Jul 27 07:59:59.019890 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 07:59:59.019890 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 07:59:59.019890 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: 7e3a5b392d9d44859110f048bea7331b Jul 27 07:59:59.019890 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-AttachVolumeTestJSON-195669691-project Jul 27 07:59:59.019890 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 07:59:59.019890 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Instance 57b781f2-0fd1-4873-9236-e01b979ce080 could not be found. Jul 27 07:59:59.019890 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': '57b781f2-0fd1-4873-9236-e01b979ce080'} Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57b781f2-0fd1-4873-9236-e01b979ce080 could not be found. Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 07:59:59.021377 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 07:59:59.022951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 07:59:59.022951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 07:59:59.022951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 07:59:59.022951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 07:59:59.022951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 07:59:59.022951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 07:59:59.022951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 07:59:59.022951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b781f2-0fd1-4873-9236-e01b979ce080 could not be found. Jul 27 07:59:59.022951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:59:59.022951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 07:59:59.022951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:59:59.022951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 07:59:59.022951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 07:59:59.022951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 07:59:59.022951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 07:59:59.022951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 07:59:59.022951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b781f2-0fd1-4873-9236-e01b979ce080 could not be found. Jul 27 07:59:59.022951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 07:59:59.024420 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-939972e3-61ac-49d9-b51a-a05c3988e755 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Returning 404 to user: Instance 57b781f2-0fd1-4873-9236-e01b979ce080 could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 07:59:59.024420 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-939972e3-61ac-49d9-b51a-a05c3988e755 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 404 len: 111 microversion: 2.1 time: 0.032844 Jul 27 07:59:59.024420 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 563/1145] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:59:58 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 07:59:59.029688 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-99bae2cf-e002-46ac-8054-2b6fb51393a9 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '.version_select at 0x7f19fe6ca940>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:59.049202 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-99bae2cf-e002-46ac-8054-2b6fb51393a9 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375459936" status: 202 len: 0 microversion: 2.1 time: 0.023516 Jul 27 07:59:59.049760 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 583/1146] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Jul 27 07:59:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375459936 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 07:59:59.989522 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-bdade6d5-8430-4567-8eb9-9581b4a2ad2f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 07:59:59.990136 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-bdade6d5-8430-4567-8eb9-9581b4a2ad2f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 07:59:59.996664 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bdade6d5-8430-4567-8eb9-9581b4a2ad2f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:59.997246 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bdade6d5-8430-4567-8eb9-9581b4a2ad2f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 07:59:59.997958 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bdade6d5-8430-4567-8eb9-9581b4a2ad2f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 07:59:59.998392 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-bdade6d5-8430-4567-8eb9-9581b4a2ad2f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:00.135869 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-bdade6d5-8430-4567-8eb9-9581b4a2ad2f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:00.143911 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-bdade6d5-8430-4567-8eb9-9581b4a2ad2f tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1265 microversion: 2.1 time: 0.158493 Jul 27 08:00:00.144484 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 564/1147] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 07:59:59 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:01.167112 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0ef7bdc8-d69e-49e2-8d97-70c5f2611712 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:01.167732 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0ef7bdc8-d69e-49e2-8d97-70c5f2611712 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:01.173933 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0ef7bdc8-d69e-49e2-8d97-70c5f2611712 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:01.174385 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0ef7bdc8-d69e-49e2-8d97-70c5f2611712 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:01.175193 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0ef7bdc8-d69e-49e2-8d97-70c5f2611712 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:01.175635 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0ef7bdc8-d69e-49e2-8d97-70c5f2611712 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:01.313528 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0ef7bdc8-d69e-49e2-8d97-70c5f2611712 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:01.321737 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0ef7bdc8-d69e-49e2-8d97-70c5f2611712 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1265 microversion: 2.1 time: 0.159080 Jul 27 08:00:01.322284 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 584/1148] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:01 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:01.958748 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-24b22134-a6b2-4bb5-9629-aaf42004d240 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:01.959268 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-24b22134-a6b2-4bb5-9629-aaf42004d240 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:01.966142 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-24b22134-a6b2-4bb5-9629-aaf42004d240 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:01.966593 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-24b22134-a6b2-4bb5-9629-aaf42004d240 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:01.967389 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-24b22134-a6b2-4bb5-9629-aaf42004d240 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:01.967826 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-24b22134-a6b2-4bb5-9629-aaf42004d240 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:01.981393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-24b22134-a6b2-4bb5-9629-aaf42004d240 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] HTTP exception thrown: Instance 57b781f2-0fd1-4873-9236-e01b979ce080 could not be found. Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-24b22134-a6b2-4bb5-9629-aaf42004d240 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Request method failure captured: Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: DELETE /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 HTTP/1.1 Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O4OfPW-7ey2k6RWU-0v9cfXiXmuAJlvO5rk6pXP6-tSwUKoNK4aQm5qpWjXsuip_TKJKni_cb3HJC33b2C7rf8_dh1s6W6GH-eaApeWoHTsOSp7nbaSQymngYGN5G-4LyzHS_pDjg5-EA8ic1y_1V5sicu9dlRAj0WWm10ix3_R9Mk Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 88e9fffbb5c6457ca3bc45c6226230a3 Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-AttachVolumeTestJSON-195669691 Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 08:00:01.982946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 08:00:01.984535 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:00:01.984535 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-AttachVolumeTestJSON-195669691 Jul 27 08:00:01.984535 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 88e9fffbb5c6457ca3bc45c6226230a3 Jul 27 08:00:01.984535 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-AttachVolumeTestJSON-195669691 Jul 27 08:00:01.984535 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-AttachVolumeTestJSON-195669691-project Jul 27 08:00:01.984535 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 08:00:01.984535 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 08:00:01.984535 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: 7e3a5b392d9d44859110f048bea7331b Jul 27 08:00:01.984535 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-AttachVolumeTestJSON-195669691-project Jul 27 08:00:01.984535 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 08:00:01.984535 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Instance 57b781f2-0fd1-4873-9236-e01b979ce080 could not be found. Jul 27 08:00:01.984535 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': '57b781f2-0fd1-4873-9236-e01b979ce080'} Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57b781f2-0fd1-4873-9236-e01b979ce080 could not be found. Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:00:01.985340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b781f2-0fd1-4873-9236-e01b979ce080 could not be found. Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b781f2-0fd1-4873-9236-e01b979ce080 could not be found. Jul 27 08:00:01.986708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:01.988247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-24b22134-a6b2-4bb5-9629-aaf42004d240 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Returning 404 to user: Instance 57b781f2-0fd1-4873-9236-e01b979ce080 could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:00:01.988247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-24b22134-a6b2-4bb5-9629-aaf42004d240 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "DELETE /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 404 len: 111 microversion: 2.1 time: 0.030060 Jul 27 08:00:01.988247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 565/1149] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 08:00:01 2022] DELETE /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:00:01.992983 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-bbb23336-d8cc-433c-b015-7b0bf8a3fe68 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:01.993602 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-bbb23336-d8cc-433c-b015-7b0bf8a3fe68 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 57b781f2-0fd1-4873-9236-e01b979ce080] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:01.999767 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bbb23336-d8cc-433c-b015-7b0bf8a3fe68 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:02.000224 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bbb23336-d8cc-433c-b015-7b0bf8a3fe68 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:02.000990 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bbb23336-d8cc-433c-b015-7b0bf8a3fe68 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:02.001430 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bbb23336-d8cc-433c-b015-7b0bf8a3fe68 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:02.015194 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-bbb23336-d8cc-433c-b015-7b0bf8a3fe68 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] HTTP exception thrown: Instance 57b781f2-0fd1-4873-9236-e01b979ce080 could not be found. Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-bbb23336-d8cc-433c-b015-7b0bf8a3fe68 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Request method failure captured: Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 HTTP/1.1 Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O4OfPW-7ey2k6RWU-0v9cfXiXmuAJlvO5rk6pXP6-tSwUKoNK4aQm5qpWjXsuip_TKJKni_cb3HJC33b2C7rf8_dh1s6W6GH-eaApeWoHTsOSp7nbaSQymngYGN5G-4LyzHS_pDjg5-EA8ic1y_1V5sicu9dlRAj0WWm10ix3_R9Mk Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 88e9fffbb5c6457ca3bc45c6226230a3 Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeTestJSON-195669691 Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 08:00:02.016855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 08:00:02.018485 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:00:02.018485 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeTestJSON-195669691 Jul 27 08:00:02.018485 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 88e9fffbb5c6457ca3bc45c6226230a3 Jul 27 08:00:02.018485 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeTestJSON-195669691 Jul 27 08:00:02.018485 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeTestJSON-195669691-project Jul 27 08:00:02.018485 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 08:00:02.018485 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 08:00:02.018485 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: 7e3a5b392d9d44859110f048bea7331b Jul 27 08:00:02.018485 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeTestJSON-195669691-project Jul 27 08:00:02.018485 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 08:00:02.018485 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance 57b781f2-0fd1-4873-9236-e01b979ce080 could not be found. Jul 27 08:00:02.018485 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': '57b781f2-0fd1-4873-9236-e01b979ce080'} Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57b781f2-0fd1-4873-9236-e01b979ce080 could not be found. Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:00:02.019513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:00:02.021642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:00:02.021642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:00:02.021642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:00:02.021642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:00:02.021642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:00:02.021642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:00:02.021642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:00:02.021642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b781f2-0fd1-4873-9236-e01b979ce080 could not be found. Jul 27 08:00:02.021642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:00:02.021642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:00:02.021642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:00:02.021642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:02.021642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:00:02.021642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:00:02.021642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:00:02.021642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:00:02.021642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b781f2-0fd1-4873-9236-e01b979ce080 could not be found. Jul 27 08:00:02.021642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:00:02.023216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-bbb23336-d8cc-433c-b015-7b0bf8a3fe68 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Returning 404 to user: Instance 57b781f2-0fd1-4873-9236-e01b979ce080 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:00:02.023216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-bbb23336-d8cc-433c-b015-7b0bf8a3fe68 tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080" status: 404 len: 111 microversion: 2.1 time: 0.029124 Jul 27 08:00:02.023216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 585/1150] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:01 2022] GET /compute/v2.1/servers/57b781f2-0fd1-4873-9236-e01b979ce080 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:00:02.343391 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9c7eb05e-171d-422c-a308-21d392266c97 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:02.344001 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-9c7eb05e-171d-422c-a308-21d392266c97 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:02.350308 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9c7eb05e-171d-422c-a308-21d392266c97 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:02.350749 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9c7eb05e-171d-422c-a308-21d392266c97 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:02.351542 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9c7eb05e-171d-422c-a308-21d392266c97 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:02.351972 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9c7eb05e-171d-422c-a308-21d392266c97 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:02.491577 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9c7eb05e-171d-422c-a308-21d392266c97 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:02.499428 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9c7eb05e-171d-422c-a308-21d392266c97 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1265 microversion: 2.1 time: 0.159767 Jul 27 08:00:02.499877 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 566/1151] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:02 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:02.963839 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-7bfff793-4ef1-4089-aeec-bd80fa7cb42e req-32459465-4f7b-4a77-84a7-16b5a1cbf02f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b810b7-1fa3-47ca-865e-d3ed7e912d52", "name": "network-vif-plugged", "status": "completed", "tag": "ec4aad5b-6031-47bc-8942-ce881969099d"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:00:02.969346 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:02.976924 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-7bfff793-4ef1-4089-aeec-bd80fa7cb42e req-32459465-4f7b-4a77-84a7-16b5a1cbf02f service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:02.977366 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-7bfff793-4ef1-4089-aeec-bd80fa7cb42e req-32459465-4f7b-4a77-84a7-16b5a1cbf02f service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:02.988810 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-7bfff793-4ef1-4089-aeec-bd80fa7cb42e req-32459465-4f7b-4a77-84a7-16b5a1cbf02f service nova] Creating event network-vif-plugged:ec4aad5b-6031-47bc-8942-ce881969099d for instance 97b810b7-1fa3-47ca-865e-d3ed7e912d52 on hv-cinder-82549 Jul 27 08:00:02.993778 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-7bfff793-4ef1-4089-aeec-bd80fa7cb42e req-32459465-4f7b-4a77-84a7-16b5a1cbf02f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033701 Jul 27 08:00:02.994618 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 586/1152] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 08:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:00:03.165036 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-df460762-f05a-49a4-847d-312c3d06ed6c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:03.165635 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-df460762-f05a-49a4-847d-312c3d06ed6c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:03.172204 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-df460762-f05a-49a4-847d-312c3d06ed6c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:03.172656 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-df460762-f05a-49a4-847d-312c3d06ed6c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:03.173498 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-df460762-f05a-49a4-847d-312c3d06ed6c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:03.173916 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-df460762-f05a-49a4-847d-312c3d06ed6c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:03.191268 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-df460762-f05a-49a4-847d-312c3d06ed6c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] HTTP exception thrown: Instance 480abe1b-7355-48b3-928a-4b32cc678979 could not be found. Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-df460762-f05a-49a4-847d-312c3d06ed6c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Request method failure captured: Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: DELETE /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 HTTP/1.1 Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O4OfPW-7ey2k6RWU-0v9cfXiXmuAJlvO5rk6pXP6-tSwUKoNK4aQm5qpWjXsuip_TKJKni_cb3HJC33b2C7rf8_dh1s6W6GH-eaApeWoHTsOSp7nbaSQymngYGN5G-4LyzHS_pDjg5-EA8ic1y_1V5sicu9dlRAj0WWm10ix3_R9Mk Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 88e9fffbb5c6457ca3bc45c6226230a3 Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-AttachVolumeTestJSON-195669691 Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 08:00:03.193363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 08:00:03.194795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:00:03.194795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-AttachVolumeTestJSON-195669691 Jul 27 08:00:03.194795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 88e9fffbb5c6457ca3bc45c6226230a3 Jul 27 08:00:03.194795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-AttachVolumeTestJSON-195669691 Jul 27 08:00:03.194795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-AttachVolumeTestJSON-195669691-project Jul 27 08:00:03.194795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 08:00:03.194795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 08:00:03.194795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: 7e3a5b392d9d44859110f048bea7331b Jul 27 08:00:03.194795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-AttachVolumeTestJSON-195669691-project Jul 27 08:00:03.194795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 08:00:03.194795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Instance 480abe1b-7355-48b3-928a-4b32cc678979 could not be found. Jul 27 08:00:03.194795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': '480abe1b-7355-48b3-928a-4b32cc678979'} Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480abe1b-7355-48b3-928a-4b32cc678979 could not be found. Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:00:03.195644 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480abe1b-7355-48b3-928a-4b32cc678979 could not be found. Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480abe1b-7355-48b3-928a-4b32cc678979 could not be found. Jul 27 08:00:03.196874 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:03.198190 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-df460762-f05a-49a4-847d-312c3d06ed6c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Returning 404 to user: Instance 480abe1b-7355-48b3-928a-4b32cc678979 could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:00:03.198190 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-df460762-f05a-49a4-847d-312c3d06ed6c tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "DELETE /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 404 len: 111 microversion: 2.1 time: 0.034750 Jul 27 08:00:03.198190 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 567/1153] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 08:00:03 2022] DELETE /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:00:03.205405 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-13a7879b-3b60-4655-a04d-a3752c1b408f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:03.206121 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-13a7879b-3b60-4655-a04d-a3752c1b408f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] [instance: 480abe1b-7355-48b3-928a-4b32cc678979] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:03.213422 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-13a7879b-3b60-4655-a04d-a3752c1b408f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:03.213871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-13a7879b-3b60-4655-a04d-a3752c1b408f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:03.214653 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-13a7879b-3b60-4655-a04d-a3752c1b408f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:03.215122 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-13a7879b-3b60-4655-a04d-a3752c1b408f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:03.229310 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-13a7879b-3b60-4655-a04d-a3752c1b408f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] HTTP exception thrown: Instance 480abe1b-7355-48b3-928a-4b32cc678979 could not be found. Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-13a7879b-3b60-4655-a04d-a3752c1b408f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Request method failure captured: Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 HTTP/1.1 Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O4OfPW-7ey2k6RWU-0v9cfXiXmuAJlvO5rk6pXP6-tSwUKoNK4aQm5qpWjXsuip_TKJKni_cb3HJC33b2C7rf8_dh1s6W6GH-eaApeWoHTsOSp7nbaSQymngYGN5G-4LyzHS_pDjg5-EA8ic1y_1V5sicu9dlRAj0WWm10ix3_R9Mk Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 88e9fffbb5c6457ca3bc45c6226230a3 Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeTestJSON-195669691 Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 08:00:03.231033 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 08:00:03.232380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/88e9fffbb5c6457ca3bc45c6226230a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:00:03.232380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeTestJSON-195669691 Jul 27 08:00:03.232380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 88e9fffbb5c6457ca3bc45c6226230a3 Jul 27 08:00:03.232380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeTestJSON-195669691 Jul 27 08:00:03.232380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeTestJSON-195669691-project Jul 27 08:00:03.232380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 08:00:03.232380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 08:00:03.232380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: 7e3a5b392d9d44859110f048bea7331b Jul 27 08:00:03.232380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeTestJSON-195669691-project Jul 27 08:00:03.232380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 08:00:03.232380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance 480abe1b-7355-48b3-928a-4b32cc678979 could not be found. Jul 27 08:00:03.232380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': '480abe1b-7355-48b3-928a-4b32cc678979'} Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480abe1b-7355-48b3-928a-4b32cc678979 could not be found. Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:00:03.233781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:00:03.235411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:00:03.235411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:00:03.235411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:00:03.235411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:00:03.235411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:00:03.235411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:00:03.235411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:00:03.235411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480abe1b-7355-48b3-928a-4b32cc678979 could not be found. Jul 27 08:00:03.235411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:00:03.235411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:00:03.235411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:00:03.235411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:03.235411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:00:03.235411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:00:03.235411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:00:03.235411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:00:03.235411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480abe1b-7355-48b3-928a-4b32cc678979 could not be found. Jul 27 08:00:03.235411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:00:03.236792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-13a7879b-3b60-4655-a04d-a3752c1b408f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] Returning 404 to user: Instance 480abe1b-7355-48b3-928a-4b32cc678979 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:00:03.236792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-13a7879b-3b60-4655-a04d-a3752c1b408f tempest-AttachVolumeTestJSON-195669691 tempest-AttachVolumeTestJSON-195669691-project] 10.222.0.18 "GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979" status: 404 len: 111 microversion: 2.1 time: 0.032551 Jul 27 08:00:03.236792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 587/1154] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:03 2022] GET /compute/v2.1/servers/480abe1b-7355-48b3-928a-4b32cc678979 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:00:03.521329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f0372f9b-a84f-4876-ba50-fb64390858ce tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:03.521972 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f0372f9b-a84f-4876-ba50-fb64390858ce tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:03.527963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f0372f9b-a84f-4876-ba50-fb64390858ce tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:03.528403 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f0372f9b-a84f-4876-ba50-fb64390858ce tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:03.529161 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f0372f9b-a84f-4876-ba50-fb64390858ce tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:03.529589 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f0372f9b-a84f-4876-ba50-fb64390858ce tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:03.662030 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f0372f9b-a84f-4876-ba50-fb64390858ce tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:03.669843 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f0372f9b-a84f-4876-ba50-fb64390858ce tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1265 microversion: 2.1 time: 0.153266 Jul 27 08:00:03.670428 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 568/1155] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:03 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:04.691095 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7bced42e-d9fd-41f8-a2eb-fb98a5cfddfc tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:04.691751 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7bced42e-d9fd-41f8-a2eb-fb98a5cfddfc tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:04.699156 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7bced42e-d9fd-41f8-a2eb-fb98a5cfddfc tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:04.700188 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7bced42e-d9fd-41f8-a2eb-fb98a5cfddfc tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:04.700877 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7bced42e-d9fd-41f8-a2eb-fb98a5cfddfc tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:04.701316 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7bced42e-d9fd-41f8-a2eb-fb98a5cfddfc tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:04.938435 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7bced42e-d9fd-41f8-a2eb-fb98a5cfddfc tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:04.946610 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7bced42e-d9fd-41f8-a2eb-fb98a5cfddfc tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1265 microversion: 2.1 time: 0.259579 Jul 27 08:00:04.960656 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 588/1156] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:04 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:05.967537 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2396e896-201c-487e-a7d6-4a32baf83643 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:05.968144 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2396e896-201c-487e-a7d6-4a32baf83643 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:05.982438 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2396e896-201c-487e-a7d6-4a32baf83643 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:05.982977 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2396e896-201c-487e-a7d6-4a32baf83643 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:05.983796 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2396e896-201c-487e-a7d6-4a32baf83643 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:05.984234 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2396e896-201c-487e-a7d6-4a32baf83643 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:06.175778 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-2396e896-201c-487e-a7d6-4a32baf83643 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:06.184819 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2396e896-201c-487e-a7d6-4a32baf83643 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1451 microversion: 2.1 time: 0.220985 Jul 27 08:00:06.185960 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 569/1157] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:05 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1451 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:06.209222 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-61e76ee7-87bf-4e56-9b54-0cea984cc9fd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:06.209850 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-61e76ee7-87bf-4e56-9b54-0cea984cc9fd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:06.218617 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-61e76ee7-87bf-4e56-9b54-0cea984cc9fd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:06.219107 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-61e76ee7-87bf-4e56-9b54-0cea984cc9fd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:06.219906 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-61e76ee7-87bf-4e56-9b54-0cea984cc9fd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:06.221025 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-61e76ee7-87bf-4e56-9b54-0cea984cc9fd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:06.481175 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-61e76ee7-87bf-4e56-9b54-0cea984cc9fd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:06.491188 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-61e76ee7-87bf-4e56-9b54-0cea984cc9fd tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1451 microversion: 2.1 time: 0.285829 Jul 27 08:00:06.491980 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 589/1158] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:06 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1451 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:08.718473 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-374de0df-67f6-443f-aeec-375961daec93 req-76fd3838-8adb-4c20-a20d-71f6162acfed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b810b7-1fa3-47ca-865e-d3ed7e912d52", "tag": "ec4aad5b-6031-47bc-8942-ce881969099d"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:00:08.728693 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-374de0df-67f6-443f-aeec-375961daec93 req-76fd3838-8adb-4c20-a20d-71f6162acfed service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:08.729143 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-374de0df-67f6-443f-aeec-375961daec93 req-76fd3838-8adb-4c20-a20d-71f6162acfed service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:08.741102 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-374de0df-67f6-443f-aeec-375961daec93 req-76fd3838-8adb-4c20-a20d-71f6162acfed service nova] Creating event network-changed:ec4aad5b-6031-47bc-8942-ce881969099d for instance 97b810b7-1fa3-47ca-865e-d3ed7e912d52 on hv-cinder-82549 Jul 27 08:00:08.746329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-374de0df-67f6-443f-aeec-375961daec93 req-76fd3838-8adb-4c20-a20d-71f6162acfed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031444 Jul 27 08:00:08.746981 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 570/1159] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 08:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:00:24.422050 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-94a4dbc8-a62f-4b5b-bead-04cc39e7339b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:24.422656 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-94a4dbc8-a62f-4b5b-bead-04cc39e7339b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:24.429684 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=7 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:24.431419 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=63 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:24.433613 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-94a4dbc8-a62f-4b5b-bead-04cc39e7339b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:24.434282 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-94a4dbc8-a62f-4b5b-bead-04cc39e7339b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:24.435317 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-94a4dbc8-a62f-4b5b-bead-04cc39e7339b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:24.436604 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-94a4dbc8-a62f-4b5b-bead-04cc39e7339b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:24.463823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-94a4dbc8-a62f-4b5b-bead-04cc39e7339b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/ips" status: 200 len: 150 microversion: 2.1 time: 0.045434 Jul 27 08:00:24.464887 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 590/1160] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Jul 27 08:00:24 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:00:25.822067 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b07fba28-4ab2-4f14-9be6-46559d16330d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94f502f7-d2dd-41f0-8c44-da02cc05bdf6"}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:00:25.824539 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b07fba28-4ab2-4f14-9be6-46559d16330d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:25.827230 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=15 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:25.827987 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:25.835278 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b07fba28-4ab2-4f14-9be6-46559d16330d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:25.835734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b07fba28-4ab2-4f14-9be6-46559d16330d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:25.836513 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b07fba28-4ab2-4f14-9be6-46559d16330d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:25.836950 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b07fba28-4ab2-4f14-9be6-46559d16330d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:26.105815 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b07fba28-4ab2-4f14-9be6-46559d16330d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "POST /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288413 Jul 27 08:00:26.106813 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 571/1161] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Jul 27 08:00:25 2022] POST /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:00:34.808436 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-64e74b0d-349e-4b66-b347-16826bd58947 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:34.809026 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-64e74b0d-349e-4b66-b347-16826bd58947 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:34.811048 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:34.811838 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=4 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:34.818482 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-64e74b0d-349e-4b66-b347-16826bd58947 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:34.818949 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-64e74b0d-349e-4b66-b347-16826bd58947 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:34.820265 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-64e74b0d-349e-4b66-b347-16826bd58947 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:34.820699 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-64e74b0d-349e-4b66-b347-16826bd58947 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:34.903035 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-64e74b0d-349e-4b66-b347-16826bd58947 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lazy-loading 'services' on Instance uuid 4aea362c-4af7-4df2-ac79-952869e1d458 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:00:34.976067 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-64e74b0d-349e-4b66-b347-16826bd58947 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/os-volume_attachments/94f502f7-d2dd-41f0-8c44-da02cc05bdf6" status: 202 len: 0 microversion: 2.1 time: 0.171459 Jul 27 08:00:34.976995 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 591/1162] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Jul 27 08:00:34 2022] DELETE /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/os-volume_attachments/94f502f7-d2dd-41f0-8c44-da02cc05bdf6 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:00:34.986283 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-dd9b2074-2990-4fb6-ba25-691d8f2c128f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:34.988864 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-dd9b2074-2990-4fb6-ba25-691d8f2c128f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:34.995794 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dd9b2074-2990-4fb6-ba25-691d8f2c128f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:34.996239 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dd9b2074-2990-4fb6-ba25-691d8f2c128f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:34.996988 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dd9b2074-2990-4fb6-ba25-691d8f2c128f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:34.997413 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dd9b2074-2990-4fb6-ba25-691d8f2c128f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:35.026297 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-dd9b2074-2990-4fb6-ba25-691d8f2c128f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044710 Jul 27 08:00:35.026832 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 572/1163] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 08:00:34 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:00:36.039293 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f63c2481-b51f-41bb-82d4-03fb35ad5230 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:36.041627 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f63c2481-b51f-41bb-82d4-03fb35ad5230 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:36.048582 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f63c2481-b51f-41bb-82d4-03fb35ad5230 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:36.049032 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f63c2481-b51f-41bb-82d4-03fb35ad5230 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:36.049806 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f63c2481-b51f-41bb-82d4-03fb35ad5230 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:36.050245 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f63c2481-b51f-41bb-82d4-03fb35ad5230 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:36.080062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f63c2481-b51f-41bb-82d4-03fb35ad5230 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045666 Jul 27 08:00:36.080615 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 592/1164] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 08:00:36 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:00:37.092624 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-55e5ffdf-53eb-4fa6-862c-4859a47777f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:37.094782 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-55e5ffdf-53eb-4fa6-862c-4859a47777f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:37.102171 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-55e5ffdf-53eb-4fa6-862c-4859a47777f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:37.102622 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-55e5ffdf-53eb-4fa6-862c-4859a47777f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:37.103413 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-55e5ffdf-53eb-4fa6-862c-4859a47777f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:37.103855 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-55e5ffdf-53eb-4fa6-862c-4859a47777f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:37.136786 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-55e5ffdf-53eb-4fa6-862c-4859a47777f0 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048153 Jul 27 08:00:37.137341 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 573/1165] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 08:00:37 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:00:38.150219 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3908b8c9-c46b-472e-8a27-db2e9dd8030e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:38.152479 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3908b8c9-c46b-472e-8a27-db2e9dd8030e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:38.159046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3908b8c9-c46b-472e-8a27-db2e9dd8030e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:38.159494 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3908b8c9-c46b-472e-8a27-db2e9dd8030e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:38.160261 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3908b8c9-c46b-472e-8a27-db2e9dd8030e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:38.160697 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3908b8c9-c46b-472e-8a27-db2e9dd8030e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:38.191018 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3908b8c9-c46b-472e-8a27-db2e9dd8030e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045605 Jul 27 08:00:38.192007 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 593/1166] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 08:00:38 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:00:39.204412 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-33f7dadb-90bd-46d8-a6bb-fae514039d7f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:39.206570 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-33f7dadb-90bd-46d8-a6bb-fae514039d7f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:39.213948 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-33f7dadb-90bd-46d8-a6bb-fae514039d7f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:39.214399 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-33f7dadb-90bd-46d8-a6bb-fae514039d7f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:39.215183 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-33f7dadb-90bd-46d8-a6bb-fae514039d7f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:39.215609 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-33f7dadb-90bd-46d8-a6bb-fae514039d7f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:39.245374 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-33f7dadb-90bd-46d8-a6bb-fae514039d7f tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044655 Jul 27 08:00:39.245939 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 574/1167] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 08:00:39 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:00:40.257873 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1b9639b5-70f8-4316-afdb-8ae2111039fb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:40.260136 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1b9639b5-70f8-4316-afdb-8ae2111039fb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:40.266641 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1b9639b5-70f8-4316-afdb-8ae2111039fb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:40.267230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1b9639b5-70f8-4316-afdb-8ae2111039fb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:40.268120 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1b9639b5-70f8-4316-afdb-8ae2111039fb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:40.268690 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1b9639b5-70f8-4316-afdb-8ae2111039fb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:40.298314 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1b9639b5-70f8-4316-afdb-8ae2111039fb tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044788 Jul 27 08:00:40.298866 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 594/1168] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Jul 27 08:00:40 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 08:00:40.362750 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c7255026-0ec3-4821-afac-96cf89c7d891 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:40.363318 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c7255026-0ec3-4821-afac-96cf89c7d891 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:40.369699 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c7255026-0ec3-4821-afac-96cf89c7d891 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:40.370145 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c7255026-0ec3-4821-afac-96cf89c7d891 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:40.370962 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c7255026-0ec3-4821-afac-96cf89c7d891 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:40.371393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c7255026-0ec3-4821-afac-96cf89c7d891 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:40.395875 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c7255026-0ec3-4821-afac-96cf89c7d891 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Going to try to terminate instance {{(pid=117779) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:00:40.474110 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c7255026-0ec3-4821-afac-96cf89c7d891 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 204 len: 0 microversion: 2.1 time: 0.115026 Jul 27 08:00:40.474951 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 575/1169] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 08:00:40 2022] DELETE /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:00:40.483745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-bff9c19c-e95f-4851-994c-766a6400c88a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:40.484365 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-bff9c19c-e95f-4851-994c-766a6400c88a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:40.490335 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bff9c19c-e95f-4851-994c-766a6400c88a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:40.490775 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bff9c19c-e95f-4851-994c-766a6400c88a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:40.491606 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bff9c19c-e95f-4851-994c-766a6400c88a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:40.492036 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bff9c19c-e95f-4851-994c-766a6400c88a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:40.620371 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bff9c19c-e95f-4851-994c-766a6400c88a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:40.627854 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-bff9c19c-e95f-4851-994c-766a6400c88a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1681 microversion: 2.1 time: 0.148232 Jul 27 08:00:40.628414 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 595/1170] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:40 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:00:41.650350 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-f9f43bb4-d2fd-42ca-bc5f-88651874ac4a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:41.651482 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-f9f43bb4-d2fd-42ca-bc5f-88651874ac4a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:41.657453 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f9f43bb4-d2fd-42ca-bc5f-88651874ac4a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:41.657897 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f9f43bb4-d2fd-42ca-bc5f-88651874ac4a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:41.658669 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f9f43bb4-d2fd-42ca-bc5f-88651874ac4a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:41.659257 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-f9f43bb4-d2fd-42ca-bc5f-88651874ac4a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:41.794546 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-f9f43bb4-d2fd-42ca-bc5f-88651874ac4a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:41.802134 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-f9f43bb4-d2fd-42ca-bc5f-88651874ac4a tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1681 microversion: 2.1 time: 0.156281 Jul 27 08:00:41.802743 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 576/1171] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:41 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:42.057339 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-eb948837-2142-4c4c-982f-a9be47992892 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:42.057940 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-eb948837-2142-4c4c-982f-a9be47992892 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:42.066237 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb948837-2142-4c4c-982f-a9be47992892 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:42.066700 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb948837-2142-4c4c-982f-a9be47992892 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:42.067513 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb948837-2142-4c4c-982f-a9be47992892 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:42.067959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb948837-2142-4c4c-982f-a9be47992892 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:42.094234 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-eb948837-2142-4c4c-982f-a9be47992892 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:00:42.180237 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-eb948837-2142-4c4c-982f-a9be47992892 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 204 len: 0 microversion: 2.1 time: 0.125862 Jul 27 08:00:42.181594 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 596/1172] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 08:00:42 2022] DELETE /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:00:42.194697 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8e83c086-467c-4bcc-a279-363070144593 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:42.195444 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8e83c086-467c-4bcc-a279-363070144593 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:42.205312 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e83c086-467c-4bcc-a279-363070144593 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:42.205769 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e83c086-467c-4bcc-a279-363070144593 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:42.206567 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e83c086-467c-4bcc-a279-363070144593 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:42.207025 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e83c086-467c-4bcc-a279-363070144593 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:42.217629 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-6cf75eef-6e99-4fb6-87eb-3dbc9f5d529a req-47a7d221-1cdc-4da6-be1b-175f27dabd5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0b0841-bd90-4361-9866-e51a7c5db994", "tag": "6eaca3f7-b87d-4766-ad60-73f678ccc493"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:00:42.228138 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-6cf75eef-6e99-4fb6-87eb-3dbc9f5d529a req-47a7d221-1cdc-4da6-be1b-175f27dabd5d service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:42.228668 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-6cf75eef-6e99-4fb6-87eb-3dbc9f5d529a req-47a7d221-1cdc-4da6-be1b-175f27dabd5d service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:42.239906 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-6cf75eef-6e99-4fb6-87eb-3dbc9f5d529a req-47a7d221-1cdc-4da6-be1b-175f27dabd5d service nova] Creating event network-changed:6eaca3f7-b87d-4766-ad60-73f678ccc493 for instance fb0b0841-bd90-4361-9866-e51a7c5db994 on hv-cinder-82549 Jul 27 08:00:42.245457 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-6cf75eef-6e99-4fb6-87eb-3dbc9f5d529a req-47a7d221-1cdc-4da6-be1b-175f27dabd5d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189690 Jul 27 08:00:42.246459 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 577/1173] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 08:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:00:42.352562 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8e83c086-467c-4bcc-a279-363070144593 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:42.360400 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8e83c086-467c-4bcc-a279-363070144593 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.174254 Jul 27 08:00:42.360978 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 597/1174] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:42 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:42.824860 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e1cb9fcd-a8d9-429c-b91d-3d46d2a922a5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:42.825559 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e1cb9fcd-a8d9-429c-b91d-3d46d2a922a5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:42.832613 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e1cb9fcd-a8d9-429c-b91d-3d46d2a922a5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:42.833053 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e1cb9fcd-a8d9-429c-b91d-3d46d2a922a5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:42.833824 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e1cb9fcd-a8d9-429c-b91d-3d46d2a922a5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:42.834251 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e1cb9fcd-a8d9-429c-b91d-3d46d2a922a5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:42.976492 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e1cb9fcd-a8d9-429c-b91d-3d46d2a922a5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:42.984661 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e1cb9fcd-a8d9-429c-b91d-3d46d2a922a5 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1681 microversion: 2.1 time: 0.164608 Jul 27 08:00:42.985228 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 578/1175] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:42 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:00:43.381903 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-602035af-1aa3-42a4-8b02-8dbbe594d07b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:43.382686 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-602035af-1aa3-42a4-8b02-8dbbe594d07b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:43.389249 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-602035af-1aa3-42a4-8b02-8dbbe594d07b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:43.389772 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-602035af-1aa3-42a4-8b02-8dbbe594d07b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:43.390601 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-602035af-1aa3-42a4-8b02-8dbbe594d07b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:43.391072 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-602035af-1aa3-42a4-8b02-8dbbe594d07b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:43.533271 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-602035af-1aa3-42a4-8b02-8dbbe594d07b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:43.541315 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-602035af-1aa3-42a4-8b02-8dbbe594d07b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.163510 Jul 27 08:00:43.541870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 598/1176] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:43 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:44.005527 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d081e276-b3ca-46df-b273-68df35c0db58 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:44.006216 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d081e276-b3ca-46df-b273-68df35c0db58 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:44.012708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d081e276-b3ca-46df-b273-68df35c0db58 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:44.013150 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d081e276-b3ca-46df-b273-68df35c0db58 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:44.013907 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d081e276-b3ca-46df-b273-68df35c0db58 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:44.014339 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d081e276-b3ca-46df-b273-68df35c0db58 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:44.142157 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-d081e276-b3ca-46df-b273-68df35c0db58 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:44.150126 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d081e276-b3ca-46df-b273-68df35c0db58 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1681 microversion: 2.1 time: 0.148481 Jul 27 08:00:44.150684 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 579/1177] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:44 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:44.562228 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8f0a9039-4693-4c90-b189-023b97415ad6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:44.562848 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8f0a9039-4693-4c90-b189-023b97415ad6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:44.570052 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8f0a9039-4693-4c90-b189-023b97415ad6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:44.570520 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8f0a9039-4693-4c90-b189-023b97415ad6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:44.571332 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8f0a9039-4693-4c90-b189-023b97415ad6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:44.571769 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8f0a9039-4693-4c90-b189-023b97415ad6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:44.705604 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8f0a9039-4693-4c90-b189-023b97415ad6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:44.713806 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8f0a9039-4693-4c90-b189-023b97415ad6 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.155617 Jul 27 08:00:44.714373 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 599/1178] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:44 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:45.172156 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7b1e6ff5-ffed-4a28-9476-33d4edbc2838 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:45.172805 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-7b1e6ff5-ffed-4a28-9476-33d4edbc2838 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:45.180112 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7b1e6ff5-ffed-4a28-9476-33d4edbc2838 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:45.180589 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7b1e6ff5-ffed-4a28-9476-33d4edbc2838 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:45.181356 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7b1e6ff5-ffed-4a28-9476-33d4edbc2838 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:45.181796 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7b1e6ff5-ffed-4a28-9476-33d4edbc2838 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:45.314499 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7b1e6ff5-ffed-4a28-9476-33d4edbc2838 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:45.322428 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7b1e6ff5-ffed-4a28-9476-33d4edbc2838 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1681 microversion: 2.1 time: 0.154175 Jul 27 08:00:45.323020 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 580/1179] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:45 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:45.734970 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6ddd4662-82c8-4745-9069-3d4a348086a9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:45.735498 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6ddd4662-82c8-4745-9069-3d4a348086a9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:45.741993 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6ddd4662-82c8-4745-9069-3d4a348086a9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:45.742429 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6ddd4662-82c8-4745-9069-3d4a348086a9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:45.743214 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6ddd4662-82c8-4745-9069-3d4a348086a9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:45.743641 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6ddd4662-82c8-4745-9069-3d4a348086a9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:45.875941 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6ddd4662-82c8-4745-9069-3d4a348086a9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:45.884283 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6ddd4662-82c8-4745-9069-3d4a348086a9 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.153250 Jul 27 08:00:45.884870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 600/1180] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:45 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:46.344588 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-3fc0a1cd-64a3-48f9-a0c0-8c914c42d572 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:46.345201 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-3fc0a1cd-64a3-48f9-a0c0-8c914c42d572 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:46.353217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3fc0a1cd-64a3-48f9-a0c0-8c914c42d572 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:46.353858 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3fc0a1cd-64a3-48f9-a0c0-8c914c42d572 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:46.355268 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3fc0a1cd-64a3-48f9-a0c0-8c914c42d572 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:46.355842 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-3fc0a1cd-64a3-48f9-a0c0-8c914c42d572 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:46.814315 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-3fc0a1cd-64a3-48f9-a0c0-8c914c42d572 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:46.822923 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-3fc0a1cd-64a3-48f9-a0c0-8c914c42d572 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1681 microversion: 2.1 time: 0.482157 Jul 27 08:00:46.838980 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 581/1181] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:46 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1681 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:46.906161 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b1a4f1e4-d0fe-462e-ae32-4662e0678578 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:46.906996 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b1a4f1e4-d0fe-462e-ae32-4662e0678578 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:46.915297 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b1a4f1e4-d0fe-462e-ae32-4662e0678578 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:46.916944 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b1a4f1e4-d0fe-462e-ae32-4662e0678578 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:46.918006 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b1a4f1e4-d0fe-462e-ae32-4662e0678578 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:46.918726 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b1a4f1e4-d0fe-462e-ae32-4662e0678578 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:47.141428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b1a4f1e4-d0fe-462e-ae32-4662e0678578 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:47.150909 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b1a4f1e4-d0fe-462e-ae32-4662e0678578 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1566 microversion: 2.1 time: 0.248590 Jul 27 08:00:47.165808 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 601/1182] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:46 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1566 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:47.240192 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-ffc4d2ec-0a4f-419d-bbb9-fcb8749c7f48 req-cc73b89a-9ffe-4185-a075-3d01e1cfa40a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aea362c-4af7-4df2-ac79-952869e1d458", "name": "network-vif-deleted", "tag": "856b98bd-bf18-4a03-969a-994a99cb10fe"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:00:47.251277 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-ffc4d2ec-0a4f-419d-bbb9-fcb8749c7f48 req-cc73b89a-9ffe-4185-a075-3d01e1cfa40a service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:47.252065 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-ffc4d2ec-0a4f-419d-bbb9-fcb8749c7f48 req-cc73b89a-9ffe-4185-a075-3d01e1cfa40a service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:47.266336 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-ffc4d2ec-0a4f-419d-bbb9-fcb8749c7f48 req-cc73b89a-9ffe-4185-a075-3d01e1cfa40a service nova] Creating event network-vif-deleted:856b98bd-bf18-4a03-969a-994a99cb10fe for instance 4aea362c-4af7-4df2-ac79-952869e1d458 on hv-cinder-82549 Jul 27 08:00:47.273236 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-ffc4d2ec-0a4f-419d-bbb9-fcb8749c7f48 req-cc73b89a-9ffe-4185-a075-3d01e1cfa40a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036191 Jul 27 08:00:47.274226 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 582/1183] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 08:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:00:47.695584 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-d0360cbd-6d84-44af-8836-9272d288690d req-11303a4e-a06f-40a1-a967-54c64e80bc69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0b0841-bd90-4361-9866-e51a7c5db994", "name": "network-vif-deleted", "tag": "6eaca3f7-b87d-4766-ad60-73f678ccc493"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:00:47.705182 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-d0360cbd-6d84-44af-8836-9272d288690d req-11303a4e-a06f-40a1-a967-54c64e80bc69 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:47.705618 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-d0360cbd-6d84-44af-8836-9272d288690d req-11303a4e-a06f-40a1-a967-54c64e80bc69 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:47.716919 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-d0360cbd-6d84-44af-8836-9272d288690d req-11303a4e-a06f-40a1-a967-54c64e80bc69 service nova] Creating event network-vif-deleted:6eaca3f7-b87d-4766-ad60-73f678ccc493 for instance fb0b0841-bd90-4361-9866-e51a7c5db994 on hv-cinder-82549 Jul 27 08:00:47.722148 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-d0360cbd-6d84-44af-8836-9272d288690d req-11303a4e-a06f-40a1-a967-54c64e80bc69 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029879 Jul 27 08:00:47.722810 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 602/1184] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 08:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:00:47.845374 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-fe4a9e02-9003-43bd-a22a-470832971370 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:47.846171 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-fe4a9e02-9003-43bd-a22a-470832971370 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:47.853414 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fe4a9e02-9003-43bd-a22a-470832971370 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:47.853858 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fe4a9e02-9003-43bd-a22a-470832971370 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:47.854656 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fe4a9e02-9003-43bd-a22a-470832971370 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:47.855126 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fe4a9e02-9003-43bd-a22a-470832971370 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:47.923222 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-fe4a9e02-9003-43bd-a22a-470832971370 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:47.930820 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-fe4a9e02-9003-43bd-a22a-470832971370 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1614 microversion: 2.1 time: 0.090044 Jul 27 08:00:47.931575 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 583/1185] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:47 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1614 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:48.173584 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9cc75f4e-945b-4288-b022-fed78972c41e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:48.174283 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9cc75f4e-945b-4288-b022-fed78972c41e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:48.181856 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9cc75f4e-945b-4288-b022-fed78972c41e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:48.182227 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9cc75f4e-945b-4288-b022-fed78972c41e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:48.183236 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9cc75f4e-945b-4288-b022-fed78972c41e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:48.183672 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9cc75f4e-945b-4288-b022-fed78972c41e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:48.252155 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9cc75f4e-945b-4288-b022-fed78972c41e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:48.260282 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9cc75f4e-945b-4288-b022-fed78972c41e tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1499 microversion: 2.1 time: 0.090886 Jul 27 08:00:48.260904 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 603/1186] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:48 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1499 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:48.952659 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-688bf7b1-0ab2-4fd9-b568-27b68c357a2b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:48.953281 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-688bf7b1-0ab2-4fd9-b568-27b68c357a2b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:48.960147 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-688bf7b1-0ab2-4fd9-b568-27b68c357a2b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:48.960595 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-688bf7b1-0ab2-4fd9-b568-27b68c357a2b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:48.961360 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-688bf7b1-0ab2-4fd9-b568-27b68c357a2b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:48.961797 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-688bf7b1-0ab2-4fd9-b568-27b68c357a2b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:49.022806 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-688bf7b1-0ab2-4fd9-b568-27b68c357a2b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:49.030248 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-688bf7b1-0ab2-4fd9-b568-27b68c357a2b tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1614 microversion: 2.1 time: 0.081630 Jul 27 08:00:49.030816 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 584/1187] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:48 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1614 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:49.281411 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5e20c940-ac85-4a06-b002-3396c9dfbc5a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:49.282004 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5e20c940-ac85-4a06-b002-3396c9dfbc5a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:49.289293 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5e20c940-ac85-4a06-b002-3396c9dfbc5a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:49.289733 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5e20c940-ac85-4a06-b002-3396c9dfbc5a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:49.290483 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5e20c940-ac85-4a06-b002-3396c9dfbc5a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:49.290958 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5e20c940-ac85-4a06-b002-3396c9dfbc5a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:49.351735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5e20c940-ac85-4a06-b002-3396c9dfbc5a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:49.359321 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5e20c940-ac85-4a06-b002-3396c9dfbc5a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1499 microversion: 2.1 time: 0.081756 Jul 27 08:00:49.359878 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 604/1188] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:49 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1499 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:50.051839 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9846acb1-f58b-447b-9d9f-124e539c2a43 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:50.052452 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-9846acb1-f58b-447b-9d9f-124e539c2a43 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:50.059715 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9846acb1-f58b-447b-9d9f-124e539c2a43 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:50.060165 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9846acb1-f58b-447b-9d9f-124e539c2a43 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:50.060932 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9846acb1-f58b-447b-9d9f-124e539c2a43 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:50.061363 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9846acb1-f58b-447b-9d9f-124e539c2a43 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:50.125876 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-9846acb1-f58b-447b-9d9f-124e539c2a43 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:50.129370 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:50.134750 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9846acb1-f58b-447b-9d9f-124e539c2a43 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1614 microversion: 2.1 time: 0.086790 Jul 27 08:00:50.135346 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 585/1189] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:50 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1614 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:50.381004 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-441d0ee1-8fca-43b5-b36b-8f09da69053a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:50.381642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-441d0ee1-8fca-43b5-b36b-8f09da69053a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:50.388863 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-441d0ee1-8fca-43b5-b36b-8f09da69053a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:50.389301 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-441d0ee1-8fca-43b5-b36b-8f09da69053a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:50.390056 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-441d0ee1-8fca-43b5-b36b-8f09da69053a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:50.390487 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-441d0ee1-8fca-43b5-b36b-8f09da69053a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:50.453900 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-441d0ee1-8fca-43b5-b36b-8f09da69053a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:50.457423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:00:50.463381 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-441d0ee1-8fca-43b5-b36b-8f09da69053a tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1380 microversion: 2.1 time: 0.085515 Jul 27 08:00:50.463581 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 605/1190] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:50 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1380 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:51.156730 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-df9026c5-4559-4cd4-8632-fd8d10b3aea9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:51.157307 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-df9026c5-4559-4cd4-8632-fd8d10b3aea9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:51.166279 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-df9026c5-4559-4cd4-8632-fd8d10b3aea9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:51.166722 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-df9026c5-4559-4cd4-8632-fd8d10b3aea9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:51.167528 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-df9026c5-4559-4cd4-8632-fd8d10b3aea9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:51.167959 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-df9026c5-4559-4cd4-8632-fd8d10b3aea9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:51.229538 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-df9026c5-4559-4cd4-8632-fd8d10b3aea9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:51.237235 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-df9026c5-4559-4cd4-8632-fd8d10b3aea9 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1614 microversion: 2.1 time: 0.084882 Jul 27 08:00:51.237794 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 586/1191] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:51 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1614 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:51.487187 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a82e4867-ce77-47a1-89bb-4520dbc84c3c tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:51.487792 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a82e4867-ce77-47a1-89bb-4520dbc84c3c tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:51.496434 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a82e4867-ce77-47a1-89bb-4520dbc84c3c tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:51.496888 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a82e4867-ce77-47a1-89bb-4520dbc84c3c tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:51.497679 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a82e4867-ce77-47a1-89bb-4520dbc84c3c tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:51.498135 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a82e4867-ce77-47a1-89bb-4520dbc84c3c tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:51.564012 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a82e4867-ce77-47a1-89bb-4520dbc84c3c tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:51.571669 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a82e4867-ce77-47a1-89bb-4520dbc84c3c tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1380 microversion: 2.1 time: 0.088413 Jul 27 08:00:51.572234 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 606/1192] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:51 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1380 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:52.260488 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-23688eb3-bd08-40b2-b8d5-a94394030539 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:52.261423 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-23688eb3-bd08-40b2-b8d5-a94394030539 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:52.268681 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-23688eb3-bd08-40b2-b8d5-a94394030539 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:52.269141 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-23688eb3-bd08-40b2-b8d5-a94394030539 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:52.269913 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-23688eb3-bd08-40b2-b8d5-a94394030539 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:52.270390 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-23688eb3-bd08-40b2-b8d5-a94394030539 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:52.302635 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-23688eb3-bd08-40b2-b8d5-a94394030539 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:52.303110 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-23688eb3-bd08-40b2-b8d5-a94394030539 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:52.303553 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.objects.instance [None req-23688eb3-bd08-40b2-b8d5-a94394030539 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lazy-loading 'fault' on Instance uuid 4aea362c-4af7-4df2-ac79-952869e1d458 {{(pid=117779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:00:52.349280 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-23688eb3-bd08-40b2-b8d5-a94394030539 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8fb928aa42413b9d03e83f46dd48bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cabcb825ebe4430a7ffa759d5e53d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:52.358218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-23688eb3-bd08-40b2-b8d5-a94394030539 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 200 len: 1331 microversion: 2.1 time: 0.102599 Jul 27 08:00:52.358819 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 587/1193] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:52 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:52.593168 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7976150e-a8d7-48bb-aad3-a0c906c1e36b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:52.593863 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7976150e-a8d7-48bb-aad3-a0c906c1e36b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:52.602617 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7976150e-a8d7-48bb-aad3-a0c906c1e36b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:52.603165 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7976150e-a8d7-48bb-aad3-a0c906c1e36b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:52.603951 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7976150e-a8d7-48bb-aad3-a0c906c1e36b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:52.604394 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7976150e-a8d7-48bb-aad3-a0c906c1e36b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:52.637456 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7976150e-a8d7-48bb-aad3-a0c906c1e36b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:52.637898 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7976150e-a8d7-48bb-aad3-a0c906c1e36b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:52.638351 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-7976150e-a8d7-48bb-aad3-a0c906c1e36b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lazy-loading 'fault' on Instance uuid fb0b0841-bd90-4361-9866-e51a7c5db994 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:00:52.679944 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7976150e-a8d7-48bb-aad3-a0c906c1e36b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd93f5d182474439bb6ea1d8b70f39b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd312b027f97e482d82eea4bdd7bb3166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:00:52.687619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7976150e-a8d7-48bb-aad3-a0c906c1e36b tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 200 len: 1223 microversion: 2.1 time: 0.098375 Jul 27 08:00:52.688219 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 607/1194] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:52 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:00:53.382143 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-22467be2-fa53-4409-9b63-af24514f5d3d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:53.383421 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-22467be2-fa53-4409-9b63-af24514f5d3d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:53.390020 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-22467be2-fa53-4409-9b63-af24514f5d3d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:53.390457 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-22467be2-fa53-4409-9b63-af24514f5d3d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:53.391242 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-22467be2-fa53-4409-9b63-af24514f5d3d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:53.391672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-22467be2-fa53-4409-9b63-af24514f5d3d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:53.404846 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-22467be2-fa53-4409-9b63-af24514f5d3d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] HTTP exception thrown: Instance 4aea362c-4af7-4df2-ac79-952869e1d458 could not be found. Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-22467be2-fa53-4409-9b63-af24514f5d3d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Request method failure captured: Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 HTTP/1.1 Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O4dQ6_Byd_TD8xXq_XrmoAr0FnlxsHKbwgQB4VAdIj5jmoqqdcTwHdIHCz-P_Xc5D3ADlxoxXrDt03El4_T3pb-Ot48U5BPQM4YOeGwU-aBen5Ed5125zCHbhJWC6gPVYWV7POipX99mXjlK6dYXCdPUlOB_d-CTA6UDGcIc4XpxPg Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 08:00:53.406456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 08:00:53.408214 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:00:53.408214 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:00:53.408214 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 08:00:53.408214 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:00:53.408214 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 08:00:53.408214 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 08:00:53.408214 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 08:00:53.408214 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: df8fb928aa42413b9d03e83f46dd48bc Jul 27 08:00:53.408214 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 08:00:53.408214 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 08:00:53.408214 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Instance 4aea362c-4af7-4df2-ac79-952869e1d458 could not be found. Jul 27 08:00:53.408214 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': '4aea362c-4af7-4df2-ac79-952869e1d458'} Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aea362c-4af7-4df2-ac79-952869e1d458 could not be found. Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:00:53.409241 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:00:53.410760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:00:53.410760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:00:53.410760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:00:53.410760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:00:53.410760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:00:53.410760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:00:53.410760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:00:53.410760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aea362c-4af7-4df2-ac79-952869e1d458 could not be found. Jul 27 08:00:53.410760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:53.410760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:00:53.410760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:53.410760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:53.410760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:00:53.410760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:00:53.410760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:00:53.410760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:00:53.410760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aea362c-4af7-4df2-ac79-952869e1d458 could not be found. Jul 27 08:00:53.410760 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:53.412170 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-22467be2-fa53-4409-9b63-af24514f5d3d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Returning 404 to user: Instance 4aea362c-4af7-4df2-ac79-952869e1d458 could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:00:53.412170 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-22467be2-fa53-4409-9b63-af24514f5d3d tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 404 len: 111 microversion: 2.1 time: 0.029687 Jul 27 08:00:53.412170 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 588/1195] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:53 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:00:53.417994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fe5e899e-e050-4ea4-858e-c9e3d972580e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '.version_select at 0x7f1a02abcb80>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:53.437070 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fe5e899e-e050-4ea4-858e-c9e3d972580e tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519444808" status: 202 len: 0 microversion: 2.1 time: 0.023424 Jul 27 08:00:53.437656 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 608/1196] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Jul 27 08:00:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519444808 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:00:53.708833 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-8be8e6a8-2aae-4d46-80cd-b30d547aeb5d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:53.709559 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-8be8e6a8-2aae-4d46-80cd-b30d547aeb5d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] [instance: fb0b0841-bd90-4361-9866-e51a7c5db994] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:53.715569 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8be8e6a8-2aae-4d46-80cd-b30d547aeb5d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:53.716015 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8be8e6a8-2aae-4d46-80cd-b30d547aeb5d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:53.716784 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8be8e6a8-2aae-4d46-80cd-b30d547aeb5d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:53.717218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8be8e6a8-2aae-4d46-80cd-b30d547aeb5d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:53.731404 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-8be8e6a8-2aae-4d46-80cd-b30d547aeb5d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] HTTP exception thrown: Instance fb0b0841-bd90-4361-9866-e51a7c5db994 could not be found. Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-8be8e6a8-2aae-4d46-80cd-b30d547aeb5d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Request method failure captured: Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 HTTP/1.1 Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O8jhvvmXbgQ6kPLFYq8mm7Pj9ua9gCNXqjxUXgov_dtm9_FjOogOLqa4EkJi0d8wrycqz3sJs8VH7sQCeUri72vl2XP6OtBbZDYMWAz2YiIvBcX_FyxZXUlfaDyv7sgwW1l0VvyBbSaKTQpYzRwYKWqBJwmbWzIVtHNQ9MPOXeStg8 Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: d312b027f97e482d82eea4bdd7bb3166 Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-TestShelveInstance-435260031 Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 08:00:53.732937 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 08:00:53.734599 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d312b027f97e482d82eea4bdd7bb3166"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d312b027f97e482d82eea4bdd7bb3166"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d312b027f97e482d82eea4bdd7bb3166"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d312b027f97e482d82eea4bdd7bb3166"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:00:53.734599 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-TestShelveInstance-435260031 Jul 27 08:00:53.734599 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: d312b027f97e482d82eea4bdd7bb3166 Jul 27 08:00:53.734599 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-TestShelveInstance-435260031 Jul 27 08:00:53.734599 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-TestShelveInstance-435260031-project Jul 27 08:00:53.734599 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 08:00:53.734599 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 08:00:53.734599 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: d93f5d182474439bb6ea1d8b70f39b2b Jul 27 08:00:53.734599 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-TestShelveInstance-435260031-project Jul 27 08:00:53.734599 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 08:00:53.734599 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Instance fb0b0841-bd90-4361-9866-e51a7c5db994 could not be found. Jul 27 08:00:53.734599 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': 'fb0b0841-bd90-4361-9866-e51a7c5db994'} Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb0b0841-bd90-4361-9866-e51a7c5db994 could not be found. Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:00:53.735672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:00:53.737218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:00:53.737218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:00:53.737218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:00:53.737218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:00:53.737218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:00:53.737218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:00:53.737218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:00:53.737218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0b0841-bd90-4361-9866-e51a7c5db994 could not be found. Jul 27 08:00:53.737218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:53.737218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:00:53.737218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:53.737218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:53.737218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:00:53.737218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:00:53.737218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:00:53.737218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:00:53.737218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0b0841-bd90-4361-9866-e51a7c5db994 could not be found. Jul 27 08:00:53.737218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:53.738605 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-8be8e6a8-2aae-4d46-80cd-b30d547aeb5d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Returning 404 to user: Instance fb0b0841-bd90-4361-9866-e51a7c5db994 could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:00:53.738605 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-8be8e6a8-2aae-4d46-80cd-b30d547aeb5d tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994" status: 404 len: 111 microversion: 2.1 time: 0.029509 Jul 27 08:00:53.738605 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 589/1197] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:53 2022] GET /compute/v2.1/servers/fb0b0841-bd90-4361-9866-e51a7c5db994 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:00:53.908139 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1829572f-8b4b-49b8-9dce-5714b255fda8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] Calling method '.version_select at 0x7f1a02c683a0>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:53.947656 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1829572f-8b4b-49b8-9dce-5714b255fda8 tempest-TestShelveInstance-435260031 tempest-TestShelveInstance-435260031-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-361390635" status: 202 len: 0 microversion: 2.1 time: 0.043952 Jul 27 08:00:53.948292 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 609/1198] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Jul 27 08:00:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-361390635 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:00:55.372745 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-39055fd2-c8ed-4505-b4b7-931005cb2d98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:55.373446 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-39055fd2-c8ed-4505-b4b7-931005cb2d98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:55.380314 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-39055fd2-c8ed-4505-b4b7-931005cb2d98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:55.380844 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-39055fd2-c8ed-4505-b4b7-931005cb2d98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:55.381714 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-39055fd2-c8ed-4505-b4b7-931005cb2d98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:55.382218 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-39055fd2-c8ed-4505-b4b7-931005cb2d98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:55.396944 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-39055fd2-c8ed-4505-b4b7-931005cb2d98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] HTTP exception thrown: Instance 4aea362c-4af7-4df2-ac79-952869e1d458 could not be found. Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-39055fd2-c8ed-4505-b4b7-931005cb2d98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Request method failure captured: Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: DELETE /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 HTTP/1.1 Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O4dQ6_Byd_TD8xXq_XrmoAr0FnlxsHKbwgQB4VAdIj5jmoqqdcTwHdIHCz-P_Xc5D3ADlxoxXrDt03El4_T3pb-Ot48U5BPQM4YOeGwU-aBen5Ed5125zCHbhJWC6gPVYWV7POipX99mXjlK6dYXCdPUlOB_d-CTA6UDGcIc4XpxPg Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 08:00:55.399247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 08:00:55.400686 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:00:55.400686 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:00:55.400686 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 08:00:55.400686 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:00:55.400686 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 08:00:55.400686 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 08:00:55.400686 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 08:00:55.400686 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: df8fb928aa42413b9d03e83f46dd48bc Jul 27 08:00:55.400686 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 08:00:55.400686 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 08:00:55.400686 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Instance 4aea362c-4af7-4df2-ac79-952869e1d458 could not be found. Jul 27 08:00:55.400686 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': '4aea362c-4af7-4df2-ac79-952869e1d458'} Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aea362c-4af7-4df2-ac79-952869e1d458 could not be found. Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:00:55.401474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aea362c-4af7-4df2-ac79-952869e1d458 could not be found. Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aea362c-4af7-4df2-ac79-952869e1d458 could not be found. Jul 27 08:00:55.402720 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:00:55.404092 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-39055fd2-c8ed-4505-b4b7-931005cb2d98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Returning 404 to user: Instance 4aea362c-4af7-4df2-ac79-952869e1d458 could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:00:55.404092 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-39055fd2-c8ed-4505-b4b7-931005cb2d98 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 404 len: 111 microversion: 2.1 time: 0.031853 Jul 27 08:00:55.404092 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 590/1199] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 08:00:55 2022] DELETE /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:00:55.409947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-56a39e1c-0303-45a8-98dc-e2402f8d9056 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:00:55.410576 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-56a39e1c-0303-45a8-98dc-e2402f8d9056 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 4aea362c-4af7-4df2-ac79-952869e1d458] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:00:55.417433 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-56a39e1c-0303-45a8-98dc-e2402f8d9056 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:55.417889 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-56a39e1c-0303-45a8-98dc-e2402f8d9056 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:55.418678 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-56a39e1c-0303-45a8-98dc-e2402f8d9056 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:00:55.423038 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-56a39e1c-0303-45a8-98dc-e2402f8d9056 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:00:55.437555 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-56a39e1c-0303-45a8-98dc-e2402f8d9056 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] HTTP exception thrown: Instance 4aea362c-4af7-4df2-ac79-952869e1d458 could not be found. Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-56a39e1c-0303-45a8-98dc-e2402f8d9056 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Request method failure captured: Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 HTTP/1.1 Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O4dQ6_Byd_TD8xXq_XrmoAr0FnlxsHKbwgQB4VAdIj5jmoqqdcTwHdIHCz-P_Xc5D3ADlxoxXrDt03El4_T3pb-Ot48U5BPQM4YOeGwU-aBen5Ed5125zCHbhJWC6gPVYWV7POipX99mXjlK6dYXCdPUlOB_d-CTA6UDGcIc4XpxPg Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 08:00:55.439258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 08:00:55.440962 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:00:55.440962 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:00:55.440962 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 08:00:55.440962 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:00:55.440962 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 08:00:55.440962 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 08:00:55.440962 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 08:00:55.440962 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: df8fb928aa42413b9d03e83f46dd48bc Jul 27 08:00:55.440962 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 08:00:55.440962 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 08:00:55.440962 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance 4aea362c-4af7-4df2-ac79-952869e1d458 could not be found. Jul 27 08:00:55.440962 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': '4aea362c-4af7-4df2-ac79-952869e1d458'} Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aea362c-4af7-4df2-ac79-952869e1d458 could not be found. Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:00:55.442524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:00:55.444709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:00:55.444709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:00:55.444709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:00:55.444709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:00:55.444709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:00:55.444709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:00:55.444709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:00:55.444709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aea362c-4af7-4df2-ac79-952869e1d458 could not be found. Jul 27 08:00:55.444709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:00:55.444709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:00:55.444709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:00:55.444709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:00:55.444709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:00:55.444709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:00:55.444709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:00:55.444709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:00:55.444709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aea362c-4af7-4df2-ac79-952869e1d458 could not be found. Jul 27 08:00:55.444709 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:00:55.446097 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-56a39e1c-0303-45a8-98dc-e2402f8d9056 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Returning 404 to user: Instance 4aea362c-4af7-4df2-ac79-952869e1d458 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:00:55.446097 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-56a39e1c-0303-45a8-98dc-e2402f8d9056 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458" status: 404 len: 111 microversion: 2.1 time: 0.035222 Jul 27 08:00:55.446097 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 610/1200] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:00:55 2022] GET /compute/v2.1/servers/4aea362c-4af7-4df2-ac79-952869e1d458 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:01:00.822854 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-5b033fae-9634-4acc-9c6d-f2e5788b26b6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:00.823402 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-5b033fae-9634-4acc-9c6d-f2e5788b26b6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:00.825716 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:00.831157 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5b033fae-9634-4acc-9c6d-f2e5788b26b6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:00.831610 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5b033fae-9634-4acc-9c6d-f2e5788b26b6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:00.832395 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5b033fae-9634-4acc-9c6d-f2e5788b26b6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:00.832831 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5b033fae-9634-4acc-9c6d-f2e5788b26b6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:00.848174 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-5b033fae-9634-4acc-9c6d-f2e5788b26b6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] HTTP exception thrown: Instance a66de7de-7505-4ee5-bf1f-ce3608663e6f could not be found. Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-5b033fae-9634-4acc-9c6d-f2e5788b26b6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Request method failure captured: Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: DELETE /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f HTTP/1.1 Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O4dQ6_Byd_TD8xXq_XrmoAr0FnlxsHKbwgQB4VAdIj5jmoqqdcTwHdIHCz-P_Xc5D3ADlxoxXrDt03El4_T3pb-Ot48U5BPQM4YOeGwU-aBen5Ed5125zCHbhJWC6gPVYWV7POipX99mXjlK6dYXCdPUlOB_d-CTA6UDGcIc4XpxPg Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 08:01:00.849873 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 08:01:00.852524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:01:00.852524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:01:00.852524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 08:01:00.852524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:01:00.852524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 08:01:00.852524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 08:01:00.852524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 08:01:00.852524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: df8fb928aa42413b9d03e83f46dd48bc Jul 27 08:01:00.852524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 08:01:00.852524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 08:01:00.852524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Instance a66de7de-7505-4ee5-bf1f-ce3608663e6f could not be found. Jul 27 08:01:00.852524 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': 'a66de7de-7505-4ee5-bf1f-ce3608663e6f'} Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a66de7de-7505-4ee5-bf1f-ce3608663e6f could not be found. Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:01:00.853305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a66de7de-7505-4ee5-bf1f-ce3608663e6f could not be found. Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a66de7de-7505-4ee5-bf1f-ce3608663e6f could not be found. Jul 27 08:01:00.854755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.856336 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-5b033fae-9634-4acc-9c6d-f2e5788b26b6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Returning 404 to user: Instance a66de7de-7505-4ee5-bf1f-ce3608663e6f could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:01:00.856336 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-5b033fae-9634-4acc-9c6d-f2e5788b26b6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 404 len: 111 microversion: 2.1 time: 0.033202 Jul 27 08:01:00.856336 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 591/1201] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 08:01:00 2022] DELETE /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:01:00.859942 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-876b2bb9-e79d-44cd-8568-f95b5d78e0d6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:00.860564 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-876b2bb9-e79d-44cd-8568-f95b5d78e0d6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a66de7de-7505-4ee5-bf1f-ce3608663e6f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:00.867343 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-876b2bb9-e79d-44cd-8568-f95b5d78e0d6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:00.867830 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-876b2bb9-e79d-44cd-8568-f95b5d78e0d6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:00.868602 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-876b2bb9-e79d-44cd-8568-f95b5d78e0d6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:00.869046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-876b2bb9-e79d-44cd-8568-f95b5d78e0d6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:00.883817 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-876b2bb9-e79d-44cd-8568-f95b5d78e0d6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] HTTP exception thrown: Instance a66de7de-7505-4ee5-bf1f-ce3608663e6f could not be found. Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-876b2bb9-e79d-44cd-8568-f95b5d78e0d6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Request method failure captured: Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f HTTP/1.1 Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O4dQ6_Byd_TD8xXq_XrmoAr0FnlxsHKbwgQB4VAdIj5jmoqqdcTwHdIHCz-P_Xc5D3ADlxoxXrDt03El4_T3pb-Ot48U5BPQM4YOeGwU-aBen5Ed5125zCHbhJWC6gPVYWV7POipX99mXjlK6dYXCdPUlOB_d-CTA6UDGcIc4XpxPg Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 08:01:00.885364 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 08:01:00.887188 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:01:00.887188 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:01:00.887188 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 08:01:00.887188 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:01:00.887188 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 08:01:00.887188 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 08:01:00.887188 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 08:01:00.887188 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: df8fb928aa42413b9d03e83f46dd48bc Jul 27 08:01:00.887188 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 08:01:00.887188 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 08:01:00.887188 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance a66de7de-7505-4ee5-bf1f-ce3608663e6f could not be found. Jul 27 08:01:00.887188 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': 'a66de7de-7505-4ee5-bf1f-ce3608663e6f'} Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a66de7de-7505-4ee5-bf1f-ce3608663e6f could not be found. Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:01:00.888457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:01:00.889979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:01:00.889979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:01:00.889979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:01:00.889979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:01:00.889979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:01:00.889979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:01:00.889979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:01:00.889979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a66de7de-7505-4ee5-bf1f-ce3608663e6f could not be found. Jul 27 08:01:00.889979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.889979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:00.889979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.889979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:00.889979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:00.889979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:00.889979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:01:00.889979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:01:00.889979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a66de7de-7505-4ee5-bf1f-ce3608663e6f could not be found. Jul 27 08:01:00.889979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.891524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-876b2bb9-e79d-44cd-8568-f95b5d78e0d6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Returning 404 to user: Instance a66de7de-7505-4ee5-bf1f-ce3608663e6f could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:01:00.891524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-876b2bb9-e79d-44cd-8568-f95b5d78e0d6 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f" status: 404 len: 111 microversion: 2.1 time: 0.030826 Jul 27 08:01:00.891524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 611/1202] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:01:00 2022] GET /compute/v2.1/servers/a66de7de-7505-4ee5-bf1f-ce3608663e6f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:01:00.898606 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9fddbcd4-4f93-454e-837c-678a049cbdce tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:00.899277 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-9fddbcd4-4f93-454e-837c-678a049cbdce tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:00.908547 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9fddbcd4-4f93-454e-837c-678a049cbdce tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:00.909291 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9fddbcd4-4f93-454e-837c-678a049cbdce tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:00.910597 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9fddbcd4-4f93-454e-837c-678a049cbdce tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:00.911347 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-9fddbcd4-4f93-454e-837c-678a049cbdce tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:00.937317 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-9fddbcd4-4f93-454e-837c-678a049cbdce tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] HTTP exception thrown: Instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 could not be found. Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9fddbcd4-4f93-454e-837c-678a049cbdce tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Request method failure captured: Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: DELETE /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 HTTP/1.1 Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O4dQ6_Byd_TD8xXq_XrmoAr0FnlxsHKbwgQB4VAdIj5jmoqqdcTwHdIHCz-P_Xc5D3ADlxoxXrDt03El4_T3pb-Ot48U5BPQM4YOeGwU-aBen5Ed5125zCHbhJWC6gPVYWV7POipX99mXjlK6dYXCdPUlOB_d-CTA6UDGcIc4XpxPg Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 08:01:00.939132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 08:01:00.940868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:01:00.940868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:01:00.940868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 08:01:00.940868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:01:00.940868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 08:01:00.940868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 08:01:00.940868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 08:01:00.940868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: df8fb928aa42413b9d03e83f46dd48bc Jul 27 08:01:00.940868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 08:01:00.940868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 08:01:00.940868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 could not be found. Jul 27 08:01:00.940868 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': 'a40e1f19-e3f4-4bc2-96d5-711703b48a28'} Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 could not be found. Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:01:00.941818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 could not be found. Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 could not be found. Jul 27 08:01:00.943197 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.944528 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9fddbcd4-4f93-454e-837c-678a049cbdce tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Returning 404 to user: Instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:01:00.944528 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9fddbcd4-4f93-454e-837c-678a049cbdce tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 404 len: 111 microversion: 2.1 time: 0.047315 Jul 27 08:01:00.944528 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 592/1203] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 08:01:00 2022] DELETE /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:01:00.950628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-749f4729-016c-41bf-a5a7-f56176a1b192 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:00.951282 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-749f4729-016c-41bf-a5a7-f56176a1b192 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: a40e1f19-e3f4-4bc2-96d5-711703b48a28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:00.957591 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-749f4729-016c-41bf-a5a7-f56176a1b192 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:00.958128 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-749f4729-016c-41bf-a5a7-f56176a1b192 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:00.958985 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-749f4729-016c-41bf-a5a7-f56176a1b192 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:00.959434 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-749f4729-016c-41bf-a5a7-f56176a1b192 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:00.977421 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-749f4729-016c-41bf-a5a7-f56176a1b192 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] HTTP exception thrown: Instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 could not be found. Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-749f4729-016c-41bf-a5a7-f56176a1b192 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Request method failure captured: Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 HTTP/1.1 Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O4dQ6_Byd_TD8xXq_XrmoAr0FnlxsHKbwgQB4VAdIj5jmoqqdcTwHdIHCz-P_Xc5D3ADlxoxXrDt03El4_T3pb-Ot48U5BPQM4YOeGwU-aBen5Ed5125zCHbhJWC6gPVYWV7POipX99mXjlK6dYXCdPUlOB_d-CTA6UDGcIc4XpxPg Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 08:01:00.979088 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 08:01:00.980811 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:01:00.980811 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:01:00.980811 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 08:01:00.980811 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:01:00.980811 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 08:01:00.980811 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 08:01:00.980811 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 08:01:00.980811 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: df8fb928aa42413b9d03e83f46dd48bc Jul 27 08:01:00.980811 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 08:01:00.980811 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 08:01:00.980811 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 could not be found. Jul 27 08:01:00.980811 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': 'a40e1f19-e3f4-4bc2-96d5-711703b48a28'} Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 could not be found. Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:01:00.981745 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:01:00.983119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:01:00.983119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:01:00.983119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:01:00.983119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:01:00.983119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:01:00.983119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:01:00.983119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:01:00.983119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 could not be found. Jul 27 08:01:00.983119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.983119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:00.983119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.983119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:00.983119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:00.983119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:00.983119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:01:00.983119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:01:00.983119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 could not be found. Jul 27 08:01:00.983119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:00.984923 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-749f4729-016c-41bf-a5a7-f56176a1b192 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Returning 404 to user: Instance a40e1f19-e3f4-4bc2-96d5-711703b48a28 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:01:00.984923 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-749f4729-016c-41bf-a5a7-f56176a1b192 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28" status: 404 len: 111 microversion: 2.1 time: 0.033807 Jul 27 08:01:00.984923 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 612/1204] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:01:00 2022] GET /compute/v2.1/servers/a40e1f19-e3f4-4bc2-96d5-711703b48a28 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:01:02.121236 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a86fc518-c713-4b82-a60d-262fbcdb5abd tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:02.121762 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a86fc518-c713-4b82-a60d-262fbcdb5abd tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:02.128242 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a86fc518-c713-4b82-a60d-262fbcdb5abd tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:02.128688 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a86fc518-c713-4b82-a60d-262fbcdb5abd tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:02.129463 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a86fc518-c713-4b82-a60d-262fbcdb5abd tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:02.129895 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a86fc518-c713-4b82-a60d-262fbcdb5abd tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:02.144237 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-a86fc518-c713-4b82-a60d-262fbcdb5abd tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] HTTP exception thrown: Instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 could not be found. Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a86fc518-c713-4b82-a60d-262fbcdb5abd tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Request method failure captured: Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: DELETE /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 HTTP/1.1 Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O4dQ6_Byd_TD8xXq_XrmoAr0FnlxsHKbwgQB4VAdIj5jmoqqdcTwHdIHCz-P_Xc5D3ADlxoxXrDt03El4_T3pb-Ot48U5BPQM4YOeGwU-aBen5Ed5125zCHbhJWC6gPVYWV7POipX99mXjlK6dYXCdPUlOB_d-CTA6UDGcIc4XpxPg Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 08:01:02.145818 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 08:01:02.147721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:01:02.147721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:01:02.147721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 08:01:02.147721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:01:02.147721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 08:01:02.147721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 08:01:02.147721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 08:01:02.147721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: df8fb928aa42413b9d03e83f46dd48bc Jul 27 08:01:02.147721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 08:01:02.147721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 08:01:02.147721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 could not be found. Jul 27 08:01:02.147721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': '2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6'} Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 could not be found. Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:01:02.148836 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 could not be found. Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 could not be found. Jul 27 08:01:02.153672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:02.155267 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a86fc518-c713-4b82-a60d-262fbcdb5abd tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Returning 404 to user: Instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:01:02.155267 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a86fc518-c713-4b82-a60d-262fbcdb5abd tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 404 len: 111 microversion: 2.1 time: 0.030501 Jul 27 08:01:02.155267 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 593/1205] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 08:01:02 2022] DELETE /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:01:02.156245 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d67a1922-bf2a-4986-9083-10a3cffb5dd2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:02.157085 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d67a1922-bf2a-4986-9083-10a3cffb5dd2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] [instance: 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:02.163939 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d67a1922-bf2a-4986-9083-10a3cffb5dd2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:02.164642 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d67a1922-bf2a-4986-9083-10a3cffb5dd2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:02.165409 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d67a1922-bf2a-4986-9083-10a3cffb5dd2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:02.166057 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d67a1922-bf2a-4986-9083-10a3cffb5dd2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:02.180171 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-d67a1922-bf2a-4986-9083-10a3cffb5dd2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] HTTP exception thrown: Instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 could not be found. Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d67a1922-bf2a-4986-9083-10a3cffb5dd2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Request method failure captured: Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 HTTP/1.1 Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O4dQ6_Byd_TD8xXq_XrmoAr0FnlxsHKbwgQB4VAdIj5jmoqqdcTwHdIHCz-P_Xc5D3ADlxoxXrDt03El4_T3pb-Ot48U5BPQM4YOeGwU-aBen5Ed5125zCHbhJWC6gPVYWV7POipX99mXjlK6dYXCdPUlOB_d-CTA6UDGcIc4XpxPg Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 08:01:02.181718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 08:01:02.183525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cabcb825ebe4430a7ffa759d5e53d2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:01:02.183525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:01:02.183525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 1cabcb825ebe4430a7ffa759d5e53d2f Jul 27 08:01:02.183525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1352527606 Jul 27 08:01:02.183525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 08:01:02.183525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 08:01:02.183525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 08:01:02.183525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: df8fb928aa42413b9d03e83f46dd48bc Jul 27 08:01:02.183525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeNegativeTest-1352527606-project Jul 27 08:01:02.183525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 08:01:02.183525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 could not be found. Jul 27 08:01:02.183525 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': '2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6'} Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 could not be found. Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:01:02.184871 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:01:02.186247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:01:02.186247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:01:02.186247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:01:02.186247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:01:02.186247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:01:02.186247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:01:02.186247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:01:02.186247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 could not be found. Jul 27 08:01:02.186247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:02.186247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:02.186247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:02.186247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:02.186247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:02.186247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:02.186247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:01:02.186247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:01:02.186247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 could not be found. Jul 27 08:01:02.186247 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:02.187412 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d67a1922-bf2a-4986-9083-10a3cffb5dd2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] Returning 404 to user: Instance 2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:01:02.187412 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d67a1922-bf2a-4986-9083-10a3cffb5dd2 tempest-AttachVolumeNegativeTest-1352527606 tempest-AttachVolumeNegativeTest-1352527606-project] 10.222.0.18 "GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6" status: 404 len: 111 microversion: 2.1 time: 0.031063 Jul 27 08:01:02.193196 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 613/1206] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:01:02 2022] GET /compute/v2.1/servers/2dd7c383-a2f2-4c2c-ad0e-9e6cdb4828c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:01:07.285276 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9e690a17-c800-4a96-8459-6fec1dd31208 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Action: 'create', calling method: .version_select at 0x7f19fe49da60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1135616023"}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:01:07.598156 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9e690a17-c800-4a96-8459-6fec1dd31208 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.578877 Jul 27 08:01:07.606554 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 594/1207] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Jul 27 08:01:07 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 580 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 27 08:01:07.612844 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7838b460-c10c-4ac5-b72c-95e9d8667bf4 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Calling method '.version_select at 0x7f1a02aa13a0>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:07.670892 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7838b460-c10c-4ac5-b72c-95e9d8667bf4 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/e1508ef4-5518-4b28-9e62-f1e37feb749b" status: 200 len: 345 microversion: 2.1 time: 0.062418 Jul 27 08:01:07.671686 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 614/1208] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Jul 27 08:01:07 2022] GET /compute/v2.1/os-volumes/e1508ef4-5518-4b28-9e62-f1e37feb749b => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:01:08.685736 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7d2ba040-558b-45ab-8755-73d16e825ef2 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Calling method '.version_select at 0x7f19fe527160>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:08.735998 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7d2ba040-558b-45ab-8755-73d16e825ef2 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/e1508ef4-5518-4b28-9e62-f1e37feb749b" status: 200 len: 346 microversion: 2.1 time: 0.054807 Jul 27 08:01:08.736583 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 595/1209] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Jul 27 08:01:08 2022] GET /compute/v2.1/os-volumes/e1508ef4-5518-4b28-9e62-f1e37feb749b => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:01:08.749837 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c76a8f6a-90a8-4527-9c6d-8c6346e7cdaf tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Action: 'create', calling method: .version_select at 0x7f1a02abc820>, body: {"snapshot": {"volume_id": "e1508ef4-5518-4b28-9e62-f1e37feb749b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1852051740"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:01:08.916325 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c76a8f6a-90a8-4527-9c6d-8c6346e7cdaf tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.170672 Jul 27 08:01:08.916920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 615/1210] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Jul 27 08:01:08 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:01:08.927775 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-195f335b-894d-4219-97fa-60cf4863d438 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Calling method '.version_select at 0x7f19fe57a670>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:08.962442 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-195f335b-894d-4219-97fa-60cf4863d438 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715" status: 200 len: 287 microversion: 2.1 time: 0.038486 Jul 27 08:01:08.963048 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 596/1211] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Jul 27 08:01:08 2022] GET /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:01:08.973674 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1f3955a8-c742-4d0d-8c39-5f133c6859bd tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Calling method '.version_select at 0x7f1a02abca60>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:09.004775 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1f3955a8-c742-4d0d-8c39-5f133c6859bd tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034992 Jul 27 08:01:09.005353 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 616/1212] 10.222.0.18 () {58 vars in 1140 bytes} [Wed Jul 27 08:01:08 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:01:09.016554 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-5e52192c-3eef-4c90-a5e1-2e58399242d5 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Calling method '.version_select at 0x7f19fe411700>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:09.046476 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-5e52192c-3eef-4c90-a5e1-2e58399242d5 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715" status: 200 len: 287 microversion: 2.1 time: 0.033534 Jul 27 08:01:09.047434 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 597/1213] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Jul 27 08:01:09 2022] GET /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:01:10.059434 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e908f8eb-fd45-456a-9933-d30a282a012e tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Calling method '.version_select at 0x7f1a02ba7430>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:10.089541 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e908f8eb-fd45-456a-9933-d30a282a012e tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715" status: 200 len: 287 microversion: 2.1 time: 0.034300 Jul 27 08:01:10.090107 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 617/1214] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Jul 27 08:01:10 2022] GET /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:01:11.103012 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d38625ac-56e9-4554-a178-49b043716459 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Calling method '.version_select at 0x7f19fe4cbd30>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:11.134660 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d38625ac-56e9-4554-a178-49b043716459 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715" status: 200 len: 287 microversion: 2.1 time: 0.036887 Jul 27 08:01:11.135508 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 598/1215] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Jul 27 08:01:11 2022] GET /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:01:12.148367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-74126a03-3e65-4613-bb65-8e33649ea100 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Calling method '.version_select at 0x7f19fe582f70>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:12.161056 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:12.170546 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=22 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:12.181399 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-74126a03-3e65-4613-bb65-8e33649ea100 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715" status: 200 len: 287 microversion: 2.1 time: 0.037508 Jul 27 08:01:12.181960 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 618/1216] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Jul 27 08:01:12 2022] GET /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:01:13.191397 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=5 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:13.192338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=26 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:13.197104 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d1fc1ed9-4a86-4017-a0b9-ea69d0e69460 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Calling method '.version_select at 0x7f19fe57a280>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:13.231234 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d1fc1ed9-4a86-4017-a0b9-ea69d0e69460 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715" status: 200 len: 287 microversion: 2.1 time: 0.041012 Jul 27 08:01:13.231807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 599/1217] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Jul 27 08:01:13 2022] GET /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:01:14.244613 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-64419fa4-243e-4796-bf54-850c5ef9e49d tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Calling method '.version_select at 0x7f19fe6d3160>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:14.276678 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-64419fa4-243e-4796-bf54-850c5ef9e49d tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715" status: 200 len: 288 microversion: 2.1 time: 0.036958 Jul 27 08:01:14.277242 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 619/1218] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Jul 27 08:01:14 2022] GET /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715 => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:01:14.288533 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-26875b91-bc69-4bf0-8763-89c74bd55fb0 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Calling method '.version_select at 0x7f19fe4dd1f0>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:14.348506 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-26875b91-bc69-4bf0-8763-89c74bd55fb0 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715" status: 202 len: 0 microversion: 2.1 time: 0.064157 Jul 27 08:01:14.349177 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 600/1219] 10.222.0.18 () {58 vars in 1254 bytes} [Wed Jul 27 08:01:14 2022] DELETE /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:01:14.357908 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9dbb8d5d-98fb-4581-88b7-f943c6ce0b30 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Calling method '.version_select at 0x7f19fe57aa60>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:14.387656 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9dbb8d5d-98fb-4581-88b7-f943c6ce0b30 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715" status: 200 len: 287 microversion: 2.1 time: 0.033546 Jul 27 08:01:14.388216 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 620/1220] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Jul 27 08:01:14 2022] GET /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:01:15.400404 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-45cd9ce4-eab5-4534-a0a5-2a57338c4e38 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Calling method '.version_select at 0x7f19fe697dc0>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:15.427707 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-45cd9ce4-eab5-4534-a0a5-2a57338c4e38 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] HTTP exception thrown: Snapshot 27443b30-f481-4b67-9c6d-e7d1e2524715 could not be found. Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-45cd9ce4-eab5-4534-a0a5-2a57338c4e38 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Request method failure captured: Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: GET /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715 HTTP/1.1 Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4PDC4isJA0TDWZ4QMuiVWUXOl4cXyut27KknnDdb0Rp_8ROWmkmuOia6tF5CRarixTfsThL-XuSpo-VlZCTqsN96chdN6bXoNSnwt-fDJ-kl4li6i6ikxsIsCIoc3DB9OWO6vFROZx9RqgXieLrmlUiyQQ4w2p6_bKnhXmNnW0bS2aQ Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: b4c9a0c794ae48cc88b0a68e79ed4e5b Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1813182695 Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 08:01:15.431098 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 08:01:15.432741 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4c9a0c794ae48cc88b0a68e79ed4e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4c9a0c794ae48cc88b0a68e79ed4e5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4c9a0c794ae48cc88b0a68e79ed4e5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4c9a0c794ae48cc88b0a68e79ed4e5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:01:15.432741 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1813182695 Jul 27 08:01:15.432741 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: b4c9a0c794ae48cc88b0a68e79ed4e5b Jul 27 08:01:15.432741 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1813182695 Jul 27 08:01:15.432741 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-VolumesSnapshotsTestJSON-1813182695-project Jul 27 08:01:15.432741 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 08:01:15.432741 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 08:01:15.432741 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: 0cde7cc809d149759eef38149c72817d Jul 27 08:01:15.432741 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1813182695-project Jul 27 08:01:15.432741 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: Jul 27 08:01:15.432741 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Snapshot 27443b30-f481-4b67-9c6d-e7d1e2524715 could not be found. Jul 27 08:01:15.432741 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': '27443b30-f481-4b67-9c6d-e7d1e2524715'} Jul 27 08:01:15.432741 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:01:15.433633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:15.433633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 27 08:01:15.433633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 27 08:01:15.433633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 27 08:01:15.433633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 27 08:01:15.433633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 27 08:01:15.433633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 27 08:01:15.433633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 08:01:15.433633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 08:01:15.433633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 08:01:15.433633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 08:01:15.433633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:01:15.433633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:01:15.433633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:01:15.433633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:01:15.433633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 27443b30-f481-4b67-9c6d-e7d1e2524715 could not be found. (HTTP 404) (Request-ID: req-f421c608-b867-48ed-9ce6-af31b02184e1) Jul 27 08:01:15.433633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:15.433633 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:15.435009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:15.435009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:15.435009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 27 08:01:15.435009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 27 08:01:15.435009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 08:01:15.435009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 08:01:15.435009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 27 08:01:15.435009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 27 08:01:15.435009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 08:01:15.435009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 08:01:15.435009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 27 08:01:15.435009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 27 08:01:15.435009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 27 08:01:15.435009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 27 08:01:15.435009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 27 08:01:15.435009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 27 08:01:15.435009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 08:01:15.435009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 08:01:15.435009 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 27443b30-f481-4b67-9c6d-e7d1e2524715 could not be found. Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 27 08:01:15.436245 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:01:15.437790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 27443b30-f481-4b67-9c6d-e7d1e2524715 could not be found. Jul 27 08:01:15.437790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:15.437790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:15.437790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:15.437790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:15.437790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:15.437790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:15.437790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:01:15.437790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:01:15.437790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 27443b30-f481-4b67-9c6d-e7d1e2524715 could not be found. Jul 27 08:01:15.437790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:15.437790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-45cd9ce4-eab5-4534-a0a5-2a57338c4e38 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Returning 404 to user: Snapshot 27443b30-f481-4b67-9c6d-e7d1e2524715 could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:01:15.437790 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-45cd9ce4-eab5-4534-a0a5-2a57338c4e38 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715" status: 404 len: 111 microversion: 2.1 time: 0.035866 Jul 27 08:01:15.438769 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 601/1221] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Jul 27 08:01:15 2022] GET /compute/v2.1/os-snapshots/27443b30-f481-4b67-9c6d-e7d1e2524715 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:01:15.441105 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1bca5c27-8426-4fe5-8d76-4600017d9c22 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Calling method '.version_select at 0x7f19fe420f70>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:15.515702 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1bca5c27-8426-4fe5-8d76-4600017d9c22 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/e1508ef4-5518-4b28-9e62-f1e37feb749b" status: 202 len: 0 microversion: 2.1 time: 0.078203 Jul 27 08:01:15.516275 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 621/1222] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Jul 27 08:01:15 2022] DELETE /compute/v2.1/os-volumes/e1508ef4-5518-4b28-9e62-f1e37feb749b => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:01:15.525229 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-1af2475c-602f-456f-aabf-9a56a4f6733f tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Calling method '.version_select at 0x7f19fe2b2700>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:15.575659 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-1af2475c-602f-456f-aabf-9a56a4f6733f tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/e1508ef4-5518-4b28-9e62-f1e37feb749b" status: 200 len: 345 microversion: 2.1 time: 0.054954 Jul 27 08:01:15.577029 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 602/1223] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Jul 27 08:01:15 2022] GET /compute/v2.1/os-volumes/e1508ef4-5518-4b28-9e62-f1e37feb749b => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:01:16.591391 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f39ef21c-af6b-4623-95d2-56af024804ac tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Calling method '.version_select at 0x7f19fe582040>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:16.619140 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-f39ef21c-af6b-4623-95d2-56af024804ac tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] HTTP exception thrown: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f39ef21c-af6b-4623-95d2-56af024804ac tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Request method failure captured: Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/os-volumes/e1508ef4-5518-4b28-9e62-f1e37feb749b HTTP/1.1 Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4PDC4isJA0TDWZ4QMuiVWUXOl4cXyut27KknnDdb0Rp_8ROWmkmuOia6tF5CRarixTfsThL-XuSpo-VlZCTqsN96chdN6bXoNSnwt-fDJ-kl4li6i6ikxsIsCIoc3DB9OWO6vFROZx9RqgXieLrmlUiyQQ4w2p6_bKnhXmNnW0bS2aQ Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: b4c9a0c794ae48cc88b0a68e79ed4e5b Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1813182695 Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 08:01:16.621086 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 08:01:16.622680 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4c9a0c794ae48cc88b0a68e79ed4e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4c9a0c794ae48cc88b0a68e79ed4e5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4c9a0c794ae48cc88b0a68e79ed4e5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4c9a0c794ae48cc88b0a68e79ed4e5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:01:16.622680 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1813182695 Jul 27 08:01:16.622680 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: b4c9a0c794ae48cc88b0a68e79ed4e5b Jul 27 08:01:16.622680 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1813182695 Jul 27 08:01:16.622680 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesSnapshotsTestJSON-1813182695-project Jul 27 08:01:16.622680 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 08:01:16.622680 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 08:01:16.622680 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: 0cde7cc809d149759eef38149c72817d Jul 27 08:01:16.622680 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1813182695-project Jul 27 08:01:16.622680 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: Jul 27 08:01:16.622680 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. Jul 27 08:01:16.622680 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': 'e1508ef4-5518-4b28-9e62-f1e37feb749b'} Jul 27 08:01:16.622680 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:01:16.623735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:16.623735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:01:16.623735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:01:16.623735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 08:01:16.623735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 08:01:16.623735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 08:01:16.623735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 08:01:16.623735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 08:01:16.623735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 08:01:16.623735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 08:01:16.623735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 08:01:16.623735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:01:16.623735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:01:16.623735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:01:16.623735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:01:16.623735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. (HTTP 404) (Request-ID: req-e190b63a-8507-4ae3-ad0a-d726c2ff6c41) Jul 27 08:01:16.623735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.623735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:16.623735 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.625146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:16.625146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 08:01:16.625146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 08:01:16.625146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 08:01:16.625146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 08:01:16.625146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 08:01:16.625146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 08:01:16.625146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 08:01:16.625146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 08:01:16.625146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:01:16.625146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:01:16.625146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 08:01:16.625146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 08:01:16.625146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 08:01:16.625146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 08:01:16.625146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 08:01:16.625146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 08:01:16.625146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 08:01:16.625146 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 08:01:16.626643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:01:16.626643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:01:16.626643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:01:16.626643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:01:16.626643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. Jul 27 08:01:16.626643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.626643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:16.626643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.626643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:16.626643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:16.626643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:16.626643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:01:16.626643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:01:16.626643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 08:01:16.626643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 08:01:16.626643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:01:16.626643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:01:16.626643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 08:01:16.626643 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:01:16.627959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. Jul 27 08:01:16.627959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.627959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:16.627959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.627959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:16.627959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:16.627959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:16.627959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:01:16.627959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:01:16.627959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. Jul 27 08:01:16.627959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.627959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f39ef21c-af6b-4623-95d2-56af024804ac tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Returning 404 to user: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:01:16.627959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f39ef21c-af6b-4623-95d2-56af024804ac tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/e1508ef4-5518-4b28-9e62-f1e37feb749b" status: 404 len: 109 microversion: 2.1 time: 0.036106 Jul 27 08:01:16.627959 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 622/1224] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Jul 27 08:01:16 2022] GET /compute/v2.1/os-volumes/e1508ef4-5518-4b28-9e62-f1e37feb749b => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 08:01:16.637906 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c0f9ceef-1ce6-45f9-a45c-00f7bb855cde tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Calling method '.version_select at 0x7f19fe37fca0>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:16.667119 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-c0f9ceef-1ce6-45f9-a45c-00f7bb855cde tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] HTTP exception thrown: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c0f9ceef-1ce6-45f9-a45c-00f7bb855cde tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Request method failure captured: Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: DELETE /compute/v2.1/os-volumes/e1508ef4-5518-4b28-9e62-f1e37feb749b HTTP/1.1 Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4PDC4isJA0TDWZ4QMuiVWUXOl4cXyut27KknnDdb0Rp_8ROWmkmuOia6tF5CRarixTfsThL-XuSpo-VlZCTqsN96chdN6bXoNSnwt-fDJ-kl4li6i6ikxsIsCIoc3DB9OWO6vFROZx9RqgXieLrmlUiyQQ4w2p6_bKnhXmNnW0bS2aQ Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: b4c9a0c794ae48cc88b0a68e79ed4e5b Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1813182695 Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 08:01:16.669063 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 08:01:16.670639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4c9a0c794ae48cc88b0a68e79ed4e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4c9a0c794ae48cc88b0a68e79ed4e5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4c9a0c794ae48cc88b0a68e79ed4e5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4c9a0c794ae48cc88b0a68e79ed4e5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:01:16.670639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1813182695 Jul 27 08:01:16.670639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: b4c9a0c794ae48cc88b0a68e79ed4e5b Jul 27 08:01:16.670639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1813182695 Jul 27 08:01:16.670639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-VolumesSnapshotsTestJSON-1813182695-project Jul 27 08:01:16.670639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 08:01:16.670639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 08:01:16.670639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: 0cde7cc809d149759eef38149c72817d Jul 27 08:01:16.670639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1813182695-project Jul 27 08:01:16.670639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: Jul 27 08:01:16.670639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. Jul 27 08:01:16.670639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': 'e1508ef4-5518-4b28-9e62-f1e37feb749b'} Jul 27 08:01:16.670639 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:01:16.671628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:16.671628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:01:16.671628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:01:16.671628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 08:01:16.671628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 08:01:16.671628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 08:01:16.671628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 08:01:16.671628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 08:01:16.671628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 08:01:16.671628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 08:01:16.671628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 08:01:16.671628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:01:16.671628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:01:16.671628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:01:16.671628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:01:16.671628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. (HTTP 404) (Request-ID: req-688a344f-a653-4055-972c-b5a19e1ae0ad) Jul 27 08:01:16.671628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.671628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:16.671628 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.673070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:16.673070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 08:01:16.673070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 08:01:16.673070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 08:01:16.673070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 08:01:16.673070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 08:01:16.673070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 08:01:16.673070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 08:01:16.673070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 08:01:16.673070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:01:16.673070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:01:16.673070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 08:01:16.673070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 08:01:16.673070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 08:01:16.673070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 08:01:16.673070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 08:01:16.673070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 08:01:16.673070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 08:01:16.673070 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 08:01:16.674734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:01:16.674734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:01:16.674734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:01:16.674734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:01:16.674734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. Jul 27 08:01:16.674734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.674734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:16.674734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.674734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:16.674734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:16.674734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:16.674734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:01:16.674734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:01:16.674734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 08:01:16.674734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 08:01:16.674734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:01:16.674734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:01:16.674734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 08:01:16.674734 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:01:16.676184 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. Jul 27 08:01:16.676184 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.676184 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:16.676184 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.676184 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:16.676184 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:16.676184 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:16.676184 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:01:16.676184 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:01:16.676184 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. Jul 27 08:01:16.676184 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.676184 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c0f9ceef-1ce6-45f9-a45c-00f7bb855cde tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Returning 404 to user: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:01:16.676184 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c0f9ceef-1ce6-45f9-a45c-00f7bb855cde tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/e1508ef4-5518-4b28-9e62-f1e37feb749b" status: 404 len: 109 microversion: 2.1 time: 0.037398 Jul 27 08:01:16.677178 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 603/1225] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Jul 27 08:01:16 2022] DELETE /compute/v2.1/os-volumes/e1508ef4-5518-4b28-9e62-f1e37feb749b => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:01:16.678920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ef836c2f-b0ec-4eed-9458-f323babb6d04 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Calling method '.version_select at 0x7f1a02a56310>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:16.711678 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-ef836c2f-b0ec-4eed-9458-f323babb6d04 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] HTTP exception thrown: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ef836c2f-b0ec-4eed-9458-f323babb6d04 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Request method failure captured: Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/os-volumes/e1508ef4-5518-4b28-9e62-f1e37feb749b HTTP/1.1 Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4PDC4isJA0TDWZ4QMuiVWUXOl4cXyut27KknnDdb0Rp_8ROWmkmuOia6tF5CRarixTfsThL-XuSpo-VlZCTqsN96chdN6bXoNSnwt-fDJ-kl4li6i6ikxsIsCIoc3DB9OWO6vFROZx9RqgXieLrmlUiyQQ4w2p6_bKnhXmNnW0bS2aQ Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: b4c9a0c794ae48cc88b0a68e79ed4e5b Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1813182695 Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 08:01:16.713708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 08:01:16.715337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4c9a0c794ae48cc88b0a68e79ed4e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b4c9a0c794ae48cc88b0a68e79ed4e5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b4c9a0c794ae48cc88b0a68e79ed4e5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b4c9a0c794ae48cc88b0a68e79ed4e5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:01:16.715337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1813182695 Jul 27 08:01:16.715337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: b4c9a0c794ae48cc88b0a68e79ed4e5b Jul 27 08:01:16.715337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1813182695 Jul 27 08:01:16.715337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesSnapshotsTestJSON-1813182695-project Jul 27 08:01:16.715337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 08:01:16.715337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 08:01:16.715337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: 0cde7cc809d149759eef38149c72817d Jul 27 08:01:16.715337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1813182695-project Jul 27 08:01:16.715337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: Jul 27 08:01:16.715337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. Jul 27 08:01:16.715337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': 'e1508ef4-5518-4b28-9e62-f1e37feb749b'} Jul 27 08:01:16.715337 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:01:16.716367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:16.716367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:01:16.716367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:01:16.716367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 08:01:16.716367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 08:01:16.716367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 08:01:16.716367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 08:01:16.716367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 08:01:16.716367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 08:01:16.716367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 08:01:16.716367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 08:01:16.716367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:01:16.716367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:01:16.716367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:01:16.716367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:01:16.716367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. (HTTP 404) (Request-ID: req-3deafa29-5aef-4886-a8bf-8ba79d00f04a) Jul 27 08:01:16.716367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.716367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:16.716367 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.717795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:16.717795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 08:01:16.717795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 08:01:16.717795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 08:01:16.717795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 08:01:16.717795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 08:01:16.717795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 08:01:16.717795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 08:01:16.717795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 08:01:16.717795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:01:16.717795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:01:16.717795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 08:01:16.717795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 08:01:16.717795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 08:01:16.717795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 08:01:16.717795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 08:01:16.717795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 08:01:16.717795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 08:01:16.717795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 08:01:16.719285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:01:16.719285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:01:16.719285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:01:16.719285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:01:16.719285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. Jul 27 08:01:16.719285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.719285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:16.719285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.719285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:16.719285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:16.719285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:16.719285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:01:16.719285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:01:16.719285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 08:01:16.719285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 08:01:16.719285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:01:16.719285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:01:16.719285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 08:01:16.719285 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:01:16.720770 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. Jul 27 08:01:16.720770 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.720770 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:16.720770 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.720770 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:16.720770 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:16.720770 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:16.720770 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:01:16.720770 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:01:16.720770 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. Jul 27 08:01:16.720770 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:16.720770 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ef836c2f-b0ec-4eed-9458-f323babb6d04 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] Returning 404 to user: Volume e1508ef4-5518-4b28-9e62-f1e37feb749b could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:01:16.720770 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ef836c2f-b0ec-4eed-9458-f323babb6d04 tempest-VolumesSnapshotsTestJSON-1813182695 tempest-VolumesSnapshotsTestJSON-1813182695-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/e1508ef4-5518-4b28-9e62-f1e37feb749b" status: 404 len: 109 microversion: 2.1 time: 0.040008 Jul 27 08:01:16.720770 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 623/1226] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Jul 27 08:01:16 2022] GET /compute/v2.1/os-volumes/e1508ef4-5518-4b28-9e62-f1e37feb749b => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:01:27.649733 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b68a8ddb-1b29-46ca-8f8e-5377c03b0611 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1611154078", "imageRef": "646bfb5d-ef25-404a-a432-35d4209840fd", "flavorRef": "452", "networks": [{"uuid": "8bc97ad6-a220-4d27-8325-eed8f0684b9f"}]}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:01:27.709141 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.network.neutron [None req-b68a8ddb-1b29-46ca-8f8e-5377c03b0611 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] validate_networks() for [('8bc97ad6-a220-4d27-8325-eed8f0684b9f', None, None, None, None, None)] {{(pid=117779) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:01:28.112796 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-b68a8ddb-1b29-46ca-8f8e-5377c03b0611 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Flavor limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:01:28.113224 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-b68a8ddb-1b29-46ca-8f8e-5377c03b0611 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Image limits 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:01:28.113702 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-b68a8ddb-1b29-46ca-8f8e-5377c03b0611 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Flavor pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:01:28.114117 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-b68a8ddb-1b29-46ca-8f8e-5377c03b0611 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Image pref 0:0:0 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:01:28.114570 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.virt.hardware [None req-b68a8ddb-1b29-46ca-8f8e-5377c03b0611 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:01:28.123546 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b68a8ddb-1b29-46ca-8f8e-5377c03b0611 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:28.124001 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b68a8ddb-1b29-46ca-8f8e-5377c03b0611 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:28.124809 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b68a8ddb-1b29-46ca-8f8e-5377c03b0611 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:28.125244 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b68a8ddb-1b29-46ca-8f8e-5377c03b0611 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:28.142128 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-b68a8ddb-1b29-46ca-8f8e-5377c03b0611 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Getting quotas for project ab5d3df5b9a5418e95246ec89a22c7df. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:01:28.146120 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.quota [None req-b68a8ddb-1b29-46ca-8f8e-5377c03b0611 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Getting quotas for user 8cf53cae7423436db120a4a0d97affae and project ab5d3df5b9a5418e95246ec89a22c7df. Resources: {'ram', 'cores', 'instances'} {{(pid=117779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:01:28.158146 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b68a8ddb-1b29-46ca-8f8e-5377c03b0611 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Going to run 1 instances... {{(pid=117779) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:01:28.160451 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b68a8ddb-1b29-46ca-8f8e-5377c03b0611 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='646bfb5d-ef25-404a-a432-35d4209840fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:01:28.206764 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b68a8ddb-1b29-46ca-8f8e-5377c03b0611 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561704 Jul 27 08:01:28.207451 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 604/1227] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 08:01:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 08:01:28.217968 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-46f321e2-80ad-4458-af52-37d8e8942c97 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:28.218588 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-46f321e2-80ad-4458-af52-37d8e8942c97 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:28.277049 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-46f321e2-80ad-4458-af52-37d8e8942c97 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:28.285958 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-46f321e2-80ad-4458-af52-37d8e8942c97 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812" status: 200 len: 1219 microversion: 2.1 time: 0.071648 Jul 27 08:01:28.286533 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 624/1228] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:01:28 2022] GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:01:29.306828 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-fc81a23c-07d4-41ab-8e76-242cfe4a6228 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:29.307475 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-fc81a23c-07d4-41ab-8e76-242cfe4a6228 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:29.314345 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fc81a23c-07d4-41ab-8e76-242cfe4a6228 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:29.314794 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fc81a23c-07d4-41ab-8e76-242cfe4a6228 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:29.315599 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fc81a23c-07d4-41ab-8e76-242cfe4a6228 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:29.316038 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fc81a23c-07d4-41ab-8e76-242cfe4a6228 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:29.385794 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-fc81a23c-07d4-41ab-8e76-242cfe4a6228 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:29.393842 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-fc81a23c-07d4-41ab-8e76-242cfe4a6228 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812" status: 200 len: 1271 microversion: 2.1 time: 0.091367 Jul 27 08:01:29.395106 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 605/1229] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:01:29 2022] GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:01:30.419731 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ce56bf4c-f143-4063-9b46-c505af372c84 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:30.421904 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ce56bf4c-f143-4063-9b46-c505af372c84 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:30.436206 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ce56bf4c-f143-4063-9b46-c505af372c84 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:30.437825 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ce56bf4c-f143-4063-9b46-c505af372c84 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:30.439387 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ce56bf4c-f143-4063-9b46-c505af372c84 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:30.440290 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ce56bf4c-f143-4063-9b46-c505af372c84 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:30.603445 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ce56bf4c-f143-4063-9b46-c505af372c84 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:30.611617 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ce56bf4c-f143-4063-9b46-c505af372c84 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812" status: 200 len: 1319 microversion: 2.1 time: 0.198696 Jul 27 08:01:30.612841 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 625/1230] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:01:30 2022] GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:01:31.383619 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-d22c132f-8910-499b-89b8-24443740536a req-9f8fc20d-27fa-42d1-983d-019043dac368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a928a05-d125-4720-ae1d-3518c7073812", "tag": "fb8b490b-3e5d-40e1-8cb6-d21de974401e"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:01:31.394013 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-d22c132f-8910-499b-89b8-24443740536a req-9f8fc20d-27fa-42d1-983d-019043dac368 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:31.394454 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-d22c132f-8910-499b-89b8-24443740536a req-9f8fc20d-27fa-42d1-983d-019043dac368 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:31.405527 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-d22c132f-8910-499b-89b8-24443740536a req-9f8fc20d-27fa-42d1-983d-019043dac368 service nova] Creating event network-changed:fb8b490b-3e5d-40e1-8cb6-d21de974401e for instance 0a928a05-d125-4720-ae1d-3518c7073812 on hv-cinder-82549 Jul 27 08:01:31.410492 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-d22c132f-8910-499b-89b8-24443740536a req-9f8fc20d-27fa-42d1-983d-019043dac368 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.260870 Jul 27 08:01:31.411118 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 606/1231] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 08:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:01:31.633199 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-16ea458d-2864-4406-b657-5223ea69cf5c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:31.634097 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-16ea458d-2864-4406-b657-5223ea69cf5c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:31.640215 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-16ea458d-2864-4406-b657-5223ea69cf5c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:31.640791 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-16ea458d-2864-4406-b657-5223ea69cf5c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:31.641421 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-16ea458d-2864-4406-b657-5223ea69cf5c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:31.642054 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-16ea458d-2864-4406-b657-5223ea69cf5c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:31.784541 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-16ea458d-2864-4406-b657-5223ea69cf5c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:31.792557 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-16ea458d-2864-4406-b657-5223ea69cf5c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812" status: 200 len: 1319 microversion: 2.1 time: 0.163358 Jul 27 08:01:31.793119 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 626/1232] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:01:31 2022] GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:01:32.815018 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-5245564f-b653-45a3-8f45-1d0dc544cab1 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:32.815724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-5245564f-b653-45a3-8f45-1d0dc544cab1 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:32.822061 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5245564f-b653-45a3-8f45-1d0dc544cab1 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:32.822552 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5245564f-b653-45a3-8f45-1d0dc544cab1 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:32.823857 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5245564f-b653-45a3-8f45-1d0dc544cab1 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:32.824288 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5245564f-b653-45a3-8f45-1d0dc544cab1 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:32.965352 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-5245564f-b653-45a3-8f45-1d0dc544cab1 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:32.972964 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-5245564f-b653-45a3-8f45-1d0dc544cab1 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812" status: 200 len: 1319 microversion: 2.1 time: 0.162575 Jul 27 08:01:32.973833 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 607/1233] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:01:32 2022] GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:01:33.095774 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-96d76b4c-1fc3-498c-bd5b-a493a91a3d39 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:33.098316 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-96d76b4c-1fc3-498c-bd5b-a493a91a3d39 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:33.105675 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-96d76b4c-1fc3-498c-bd5b-a493a91a3d39 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:33.106133 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-96d76b4c-1fc3-498c-bd5b-a493a91a3d39 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:33.106941 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-96d76b4c-1fc3-498c-bd5b-a493a91a3d39 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:33.107424 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-96d76b4c-1fc3-498c-bd5b-a493a91a3d39 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:33.138723 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-96d76b4c-1fc3-498c-bd5b-a493a91a3d39 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047112 Jul 27 08:01:33.139507 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 627/1234] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Jul 27 08:01:33 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:01:33.203931 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-5423aeb9-4307-462c-8263-72297aa03c57 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:33.204551 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-5423aeb9-4307-462c-8263-72297aa03c57 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:33.211075 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5423aeb9-4307-462c-8263-72297aa03c57 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:33.211334 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5423aeb9-4307-462c-8263-72297aa03c57 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:33.212177 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5423aeb9-4307-462c-8263-72297aa03c57 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:33.212684 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5423aeb9-4307-462c-8263-72297aa03c57 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:33.238036 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-5423aeb9-4307-462c-8263-72297aa03c57 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Going to try to terminate instance {{(pid=117779) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:01:33.318981 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-5423aeb9-4307-462c-8263-72297aa03c57 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 204 len: 0 microversion: 2.20 time: 0.118955 Jul 27 08:01:33.323272 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 608/1235] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Jul 27 08:01:33 2022] DELETE /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 08:01:33.332100 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-55ddaae3-56df-4381-99b2-72d98a087357 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:33.332823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-55ddaae3-56df-4381-99b2-72d98a087357 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:33.339212 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55ddaae3-56df-4381-99b2-72d98a087357 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:33.339653 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55ddaae3-56df-4381-99b2-72d98a087357 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:33.340418 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55ddaae3-56df-4381-99b2-72d98a087357 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:33.340852 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55ddaae3-56df-4381-99b2-72d98a087357 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:33.476984 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-55ddaae3-56df-4381-99b2-72d98a087357 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:33.486314 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-55ddaae3-56df-4381-99b2-72d98a087357 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:33.487841 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-55ddaae3-56df-4381-99b2-72d98a087357 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:33.488997 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-55ddaae3-56df-4381-99b2-72d98a087357 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1725 microversion: 2.20 time: 0.160882 Jul 27 08:01:33.489544 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 628/1236] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 08:01:33 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:01:33.995502 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b8b0af13-e424-42c1-ae9d-31025700d3b1 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:33.996217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b8b0af13-e424-42c1-ae9d-31025700d3b1 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:34.002706 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b8b0af13-e424-42c1-ae9d-31025700d3b1 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:34.003187 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b8b0af13-e424-42c1-ae9d-31025700d3b1 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:34.003955 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b8b0af13-e424-42c1-ae9d-31025700d3b1 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:34.004394 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b8b0af13-e424-42c1-ae9d-31025700d3b1 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:34.138504 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b8b0af13-e424-42c1-ae9d-31025700d3b1 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:34.146228 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b8b0af13-e424-42c1-ae9d-31025700d3b1 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812" status: 200 len: 1319 microversion: 2.1 time: 0.155067 Jul 27 08:01:34.146804 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 609/1237] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:01:33 2022] GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:01:34.512407 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c32c588a-a5f1-4ee8-ab1c-e8a98feb4a41 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:34.512995 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c32c588a-a5f1-4ee8-ab1c-e8a98feb4a41 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:34.519945 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c32c588a-a5f1-4ee8-ab1c-e8a98feb4a41 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:34.520396 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c32c588a-a5f1-4ee8-ab1c-e8a98feb4a41 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:34.521169 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c32c588a-a5f1-4ee8-ab1c-e8a98feb4a41 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:34.521607 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c32c588a-a5f1-4ee8-ab1c-e8a98feb4a41 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:34.651414 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c32c588a-a5f1-4ee8-ab1c-e8a98feb4a41 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:34.659629 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c32c588a-a5f1-4ee8-ab1c-e8a98feb4a41 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:34.661148 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c32c588a-a5f1-4ee8-ab1c-e8a98feb4a41 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:34.662308 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c32c588a-a5f1-4ee8-ab1c-e8a98feb4a41 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1725 microversion: 2.20 time: 0.154461 Jul 27 08:01:34.662874 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 629/1238] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 08:01:34 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:01:35.168462 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-236b5619-f9e7-467a-b0dc-6aaeeecdd8c8 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:35.169084 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-236b5619-f9e7-467a-b0dc-6aaeeecdd8c8 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:35.175707 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-236b5619-f9e7-467a-b0dc-6aaeeecdd8c8 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:35.176161 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-236b5619-f9e7-467a-b0dc-6aaeeecdd8c8 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:35.176933 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-236b5619-f9e7-467a-b0dc-6aaeeecdd8c8 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:35.177374 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-236b5619-f9e7-467a-b0dc-6aaeeecdd8c8 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:35.321897 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-236b5619-f9e7-467a-b0dc-6aaeeecdd8c8 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:35.330078 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-236b5619-f9e7-467a-b0dc-6aaeeecdd8c8 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812" status: 200 len: 1319 microversion: 2.1 time: 0.166387 Jul 27 08:01:35.330650 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 610/1239] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:01:35 2022] GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:01:35.687521 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b69dc853-0a27-4e96-9b61-e8cdf3bcb5ee tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:35.688143 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b69dc853-0a27-4e96-9b61-e8cdf3bcb5ee tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:35.694861 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b69dc853-0a27-4e96-9b61-e8cdf3bcb5ee tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:35.695413 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b69dc853-0a27-4e96-9b61-e8cdf3bcb5ee tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:35.696318 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b69dc853-0a27-4e96-9b61-e8cdf3bcb5ee tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:35.696935 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b69dc853-0a27-4e96-9b61-e8cdf3bcb5ee tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:35.828757 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b69dc853-0a27-4e96-9b61-e8cdf3bcb5ee tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:35.836789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b69dc853-0a27-4e96-9b61-e8cdf3bcb5ee tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:35.838312 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b69dc853-0a27-4e96-9b61-e8cdf3bcb5ee tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:35.839586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b69dc853-0a27-4e96-9b61-e8cdf3bcb5ee tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1725 microversion: 2.20 time: 0.156122 Jul 27 08:01:35.840156 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 630/1240] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 08:01:35 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:01:36.352006 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-b09ff0a8-c89a-41fd-8fca-023fe36df18e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:36.352621 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-b09ff0a8-c89a-41fd-8fca-023fe36df18e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:36.359679 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b09ff0a8-c89a-41fd-8fca-023fe36df18e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:36.360129 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b09ff0a8-c89a-41fd-8fca-023fe36df18e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:36.360894 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b09ff0a8-c89a-41fd-8fca-023fe36df18e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:36.361329 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-b09ff0a8-c89a-41fd-8fca-023fe36df18e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:36.492915 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-b09ff0a8-c89a-41fd-8fca-023fe36df18e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:36.500352 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-b09ff0a8-c89a-41fd-8fca-023fe36df18e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812" status: 200 len: 1319 microversion: 2.1 time: 0.152489 Jul 27 08:01:36.500915 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 611/1241] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:01:36 2022] GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:01:36.864211 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-aed98051-526e-41d0-8ff7-1a4bc16549f7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:36.864957 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-aed98051-526e-41d0-8ff7-1a4bc16549f7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:36.872224 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aed98051-526e-41d0-8ff7-1a4bc16549f7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:36.872771 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aed98051-526e-41d0-8ff7-1a4bc16549f7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:36.873628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aed98051-526e-41d0-8ff7-1a4bc16549f7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:36.874224 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aed98051-526e-41d0-8ff7-1a4bc16549f7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:37.015923 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-aed98051-526e-41d0-8ff7-1a4bc16549f7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:37.026841 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-aed98051-526e-41d0-8ff7-1a4bc16549f7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:37.028578 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-aed98051-526e-41d0-8ff7-1a4bc16549f7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb3d3ca2457b47a29b7c94bd8be450cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690822c00bf34b2d90eee3e2026c78fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:37.029809 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-aed98051-526e-41d0-8ff7-1a4bc16549f7 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 200 len: 1725 microversion: 2.20 time: 0.169620 Jul 27 08:01:37.039250 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 631/1242] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 08:01:36 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 08:01:37.382130 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-ea57536b-e233-4fd2-896f-e8eab69b385e req-f0237bed-2707-418e-899b-3767b8a174fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2", "name": "network-vif-deleted", "tag": "19f48487-6051-4c27-9a27-015b3b0d174a"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:01:37.393609 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-ea57536b-e233-4fd2-896f-e8eab69b385e req-f0237bed-2707-418e-899b-3767b8a174fa service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:37.394478 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-ea57536b-e233-4fd2-896f-e8eab69b385e req-f0237bed-2707-418e-899b-3767b8a174fa service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:37.407346 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-ea57536b-e233-4fd2-896f-e8eab69b385e req-f0237bed-2707-418e-899b-3767b8a174fa service nova] Creating event network-vif-deleted:19f48487-6051-4c27-9a27-015b3b0d174a for instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 on hv-cinder-82549 Jul 27 08:01:37.414564 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-ea57536b-e233-4fd2-896f-e8eab69b385e req-f0237bed-2707-418e-899b-3767b8a174fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037305 Jul 27 08:01:37.415892 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 612/1243] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 08:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:01:37.523564 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5fda574c-b31a-48b4-9999-5c84514e18d9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:37.524620 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5fda574c-b31a-48b4-9999-5c84514e18d9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:37.533420 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5fda574c-b31a-48b4-9999-5c84514e18d9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:37.533979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5fda574c-b31a-48b4-9999-5c84514e18d9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:37.534842 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5fda574c-b31a-48b4-9999-5c84514e18d9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:37.535380 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5fda574c-b31a-48b4-9999-5c84514e18d9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:37.690439 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5fda574c-b31a-48b4-9999-5c84514e18d9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:37.697989 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5fda574c-b31a-48b4-9999-5c84514e18d9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812" status: 200 len: 1319 microversion: 2.1 time: 0.180332 Jul 27 08:01:37.698559 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 632/1244] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:01:37 2022] GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:01:37.981489 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-e84e616f-fe62-42e6-9c86-35c8d6bcb465 req-8f9be196-a882-49c4-ac3a-4f76de6cb292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a928a05-d125-4720-ae1d-3518c7073812", "name": "network-vif-plugged", "status": "completed", "tag": "fb8b490b-3e5d-40e1-8cb6-d21de974401e"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:01:37.993631 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-e84e616f-fe62-42e6-9c86-35c8d6bcb465 req-8f9be196-a882-49c4-ac3a-4f76de6cb292 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:37.994772 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-e84e616f-fe62-42e6-9c86-35c8d6bcb465 req-8f9be196-a882-49c4-ac3a-4f76de6cb292 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:38.007992 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-e84e616f-fe62-42e6-9c86-35c8d6bcb465 req-8f9be196-a882-49c4-ac3a-4f76de6cb292 service nova] Creating event network-vif-plugged:fb8b490b-3e5d-40e1-8cb6-d21de974401e for instance 0a928a05-d125-4720-ae1d-3518c7073812 on hv-cinder-82549 Jul 27 08:01:38.013448 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-e84e616f-fe62-42e6-9c86-35c8d6bcb465 req-8f9be196-a882-49c4-ac3a-4f76de6cb292 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203186 Jul 27 08:01:38.014341 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 613/1245] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 08:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:01:38.054758 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-767895c3-eab8-49db-994f-3d7f70aca89f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:38.056711 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-767895c3-eab8-49db-994f-3d7f70aca89f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:38.064814 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-767895c3-eab8-49db-994f-3d7f70aca89f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:38.065635 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-767895c3-eab8-49db-994f-3d7f70aca89f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:38.067027 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-767895c3-eab8-49db-994f-3d7f70aca89f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:38.067878 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-767895c3-eab8-49db-994f-3d7f70aca89f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:38.083385 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-767895c3-eab8-49db-994f-3d7f70aca89f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] HTTP exception thrown: Instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 could not be found. Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-767895c3-eab8-49db-994f-3d7f70aca89f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Request method failure captured: Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 HTTP/1.1 Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O4bp8Zj_qDlg-bwEJhF_0lePKtwlqhoITgzOUBl5V3Ie-Hp1jAqFLIvjXBKXQ6h780mUk5eQjA8Yb8XHGifoBm-khbEDCypukHixCybEhpPLTCRJiHKZtJHhYPENCcZ3YFRHOeieWYAgf4xDsvgBHdx7S6tiHtHm6E1NfcrbIEd33o Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 690822c00bf34b2d90eee3e2026c78fb Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2009920425 Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 08:01:38.085046 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 08:01:38.086538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:01:38.086538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2009920425 Jul 27 08:01:38.086538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 690822c00bf34b2d90eee3e2026c78fb Jul 27 08:01:38.086538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2009920425 Jul 27 08:01:38.086538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeShelveTestJSON-2009920425-project Jul 27 08:01:38.086538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 08:01:38.086538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 08:01:38.086538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: eb3d3ca2457b47a29b7c94bd8be450cd Jul 27 08:01:38.086538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2009920425-project Jul 27 08:01:38.086538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 08:01:38.086538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 could not be found. Jul 27 08:01:38.086538 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': '3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2'} Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 could not be found. Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:01:38.087531 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:01:38.089595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:01:38.089595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:01:38.089595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:01:38.089595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:01:38.089595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:01:38.089595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:01:38.089595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:01:38.089595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 could not be found. Jul 27 08:01:38.089595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:38.089595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:38.089595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:38.089595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:38.089595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:38.089595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:38.089595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:01:38.089595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:01:38.089595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 could not be found. Jul 27 08:01:38.089595 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:38.091659 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-767895c3-eab8-49db-994f-3d7f70aca89f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Returning 404 to user: Instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:01:38.091659 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-767895c3-eab8-49db-994f-3d7f70aca89f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 404 len: 111 microversion: 2.20 time: 0.037555 Jul 27 08:01:38.091659 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 633/1246] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 08:01:38 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 27 08:01:38.096735 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-9d5d9277-bd64-464b-bfea-4d3ab9876b80 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '.version_select at 0x7f19fe4cb5e0>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:38.130510 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-9d5d9277-bd64-464b-bfea-4d3ab9876b80 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777267258" status: 204 len: 0 microversion: 2.20 time: 0.037866 Jul 27 08:01:38.131486 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 614/1247] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Jul 27 08:01:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777267258 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 08:01:38.719769 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-717a6959-8fb0-4b52-b61f-1eccdabe3084 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:38.720664 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-717a6959-8fb0-4b52-b61f-1eccdabe3084 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:38.726240 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:38.728326 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-717a6959-8fb0-4b52-b61f-1eccdabe3084 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:38.728838 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-717a6959-8fb0-4b52-b61f-1eccdabe3084 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:38.730115 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-717a6959-8fb0-4b52-b61f-1eccdabe3084 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:38.730581 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-717a6959-8fb0-4b52-b61f-1eccdabe3084 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:38.892790 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-717a6959-8fb0-4b52-b61f-1eccdabe3084 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:38.904078 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-717a6959-8fb0-4b52-b61f-1eccdabe3084 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812" status: 200 len: 1319 microversion: 2.1 time: 0.187579 Jul 27 08:01:38.905205 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 634/1248] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:01:38 2022] GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:01:39.923179 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=2 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:39.923946 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell0:SELECT=6 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:01:39.928269 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-57bd55f3-81e9-45be-a1c6-28dc24d643a0 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:39.928975 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-57bd55f3-81e9-45be-a1c6-28dc24d643a0 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:39.936824 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-57bd55f3-81e9-45be-a1c6-28dc24d643a0 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:39.937272 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-57bd55f3-81e9-45be-a1c6-28dc24d643a0 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:39.938045 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-57bd55f3-81e9-45be-a1c6-28dc24d643a0 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:39.938476 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-57bd55f3-81e9-45be-a1c6-28dc24d643a0 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:40.052789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-19417396-3d8f-441f-841b-69818b0b207f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:40.053464 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-19417396-3d8f-441f-841b-69818b0b207f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:40.060493 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-19417396-3d8f-441f-841b-69818b0b207f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:40.061200 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-19417396-3d8f-441f-841b-69818b0b207f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:40.061964 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-19417396-3d8f-441f-841b-69818b0b207f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:40.062395 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-19417396-3d8f-441f-841b-69818b0b207f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:40.076449 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-57bd55f3-81e9-45be-a1c6-28dc24d643a0 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:40.076821 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-19417396-3d8f-441f-841b-69818b0b207f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] HTTP exception thrown: Instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 could not be found. Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-19417396-3d8f-441f-841b-69818b0b207f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Request method failure captured: Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: DELETE /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 HTTP/1.1 Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O4bp8Zj_qDlg-bwEJhF_0lePKtwlqhoITgzOUBl5V3Ie-Hp1jAqFLIvjXBKXQ6h780mUk5eQjA8Yb8XHGifoBm-khbEDCypukHixCybEhpPLTCRJiHKZtJHhYPENCcZ3YFRHOeieWYAgf4xDsvgBHdx7S6tiHtHm6E1NfcrbIEd33o Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 690822c00bf34b2d90eee3e2026c78fb Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2009920425 Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 08:01:40.078244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 08:01:40.080131 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:01:40.080131 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2009920425 Jul 27 08:01:40.080131 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 690822c00bf34b2d90eee3e2026c78fb Jul 27 08:01:40.080131 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2009920425 Jul 27 08:01:40.080131 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeShelveTestJSON-2009920425-project Jul 27 08:01:40.080131 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 08:01:40.080131 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 08:01:40.080131 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: eb3d3ca2457b47a29b7c94bd8be450cd Jul 27 08:01:40.080131 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2009920425-project Jul 27 08:01:40.080131 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 08:01:40.080131 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 could not be found. Jul 27 08:01:40.080131 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': '3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2'} Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 could not be found. Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:01:40.080972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 could not be found. Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 could not be found. Jul 27 08:01:40.082230 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:40.083544 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-19417396-3d8f-441f-841b-69818b0b207f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Returning 404 to user: Instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:01:40.083544 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-19417396-3d8f-441f-841b-69818b0b207f tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 404 len: 111 microversion: 2.20 time: 0.030989 Jul 27 08:01:40.083544 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 635/1249] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Jul 27 08:01:40 2022] DELETE /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 27 08:01:40.085268 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-57bd55f3-81e9-45be-a1c6-28dc24d643a0 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812" status: 200 len: 1319 microversion: 2.1 time: 0.162853 Jul 27 08:01:40.085837 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 615/1250] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:01:39 2022] GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:01:40.088312 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-275ec338-60ab-4555-a24f-882d11d11c50 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:40.089151 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-275ec338-60ab-4555-a24f-882d11d11c50 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:40.095407 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-275ec338-60ab-4555-a24f-882d11d11c50 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:40.095854 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-275ec338-60ab-4555-a24f-882d11d11c50 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:40.096613 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-275ec338-60ab-4555-a24f-882d11d11c50 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:40.097042 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-275ec338-60ab-4555-a24f-882d11d11c50 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:40.112048 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-275ec338-60ab-4555-a24f-882d11d11c50 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] HTTP exception thrown: Instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 could not be found. Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-275ec338-60ab-4555-a24f-882d11d11c50 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Request method failure captured: Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 HTTP/1.1 Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O4bp8Zj_qDlg-bwEJhF_0lePKtwlqhoITgzOUBl5V3Ie-Hp1jAqFLIvjXBKXQ6h780mUk5eQjA8Yb8XHGifoBm-khbEDCypukHixCybEhpPLTCRJiHKZtJHhYPENCcZ3YFRHOeieWYAgf4xDsvgBHdx7S6tiHtHm6E1NfcrbIEd33o Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 690822c00bf34b2d90eee3e2026c78fb Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2009920425 Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 08:01:40.113586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 08:01:40.115464 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:01:40.115464 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2009920425 Jul 27 08:01:40.115464 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 690822c00bf34b2d90eee3e2026c78fb Jul 27 08:01:40.115464 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2009920425 Jul 27 08:01:40.115464 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeShelveTestJSON-2009920425-project Jul 27 08:01:40.115464 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 08:01:40.115464 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 08:01:40.115464 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: eb3d3ca2457b47a29b7c94bd8be450cd Jul 27 08:01:40.115464 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2009920425-project Jul 27 08:01:40.115464 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 08:01:40.115464 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 could not be found. Jul 27 08:01:40.115464 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': '3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2'} Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 could not be found. Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:01:40.116392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:01:40.118020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:01:40.118020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:01:40.118020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:01:40.118020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:01:40.118020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:01:40.118020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:01:40.118020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:01:40.118020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 could not be found. Jul 27 08:01:40.118020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:40.118020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:40.118020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:40.118020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:40.118020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:40.118020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:40.118020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:01:40.118020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:01:40.118020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 could not be found. Jul 27 08:01:40.118020 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:40.120082 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-275ec338-60ab-4555-a24f-882d11d11c50 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Returning 404 to user: Instance 3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:01:40.120082 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-275ec338-60ab-4555-a24f-882d11d11c50 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2" status: 404 len: 111 microversion: 2.20 time: 0.030486 Jul 27 08:01:40.120082 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 636/1251] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 08:01:40 2022] GET /compute/v2.1/servers/3c8e526d-f9ed-4a51-bfb1-fc1e7dda84d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 08:01:41.107231 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-fae85e6a-b920-46f5-a90c-f10ef471c38a tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:41.107930 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-fae85e6a-b920-46f5-a90c-f10ef471c38a tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:41.114273 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fae85e6a-b920-46f5-a90c-f10ef471c38a tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:41.114826 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fae85e6a-b920-46f5-a90c-f10ef471c38a tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:41.115616 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fae85e6a-b920-46f5-a90c-f10ef471c38a tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:41.116121 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-fae85e6a-b920-46f5-a90c-f10ef471c38a tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:41.262286 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-fae85e6a-b920-46f5-a90c-f10ef471c38a tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:01:41.262630 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ea984ffe-76af-42bb-bfcc-98eda13f1f18 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:41.263219 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ea984ffe-76af-42bb-bfcc-98eda13f1f18 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:41.271258 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ea984ffe-76af-42bb-bfcc-98eda13f1f18 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:41.271836 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ea984ffe-76af-42bb-bfcc-98eda13f1f18 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:41.272626 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ea984ffe-76af-42bb-bfcc-98eda13f1f18 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:41.272918 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-fae85e6a-b920-46f5-a90c-f10ef471c38a tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812" status: 200 len: 1507 microversion: 2.1 time: 0.170327 Jul 27 08:01:41.273049 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ea984ffe-76af-42bb-bfcc-98eda13f1f18 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:41.286928 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-ea984ffe-76af-42bb-bfcc-98eda13f1f18 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] HTTP exception thrown: Instance 880126db-79f5-4c11-a0b5-85a612a1662a could not be found. Jul 27 08:01:41.287485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 616/1252] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:01:41 2022] GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ea984ffe-76af-42bb-bfcc-98eda13f1f18 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Request method failure captured: Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: DELETE /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a HTTP/1.1 Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O4bp8Zj_qDlg-bwEJhF_0lePKtwlqhoITgzOUBl5V3Ie-Hp1jAqFLIvjXBKXQ6h780mUk5eQjA8Yb8XHGifoBm-khbEDCypukHixCybEhpPLTCRJiHKZtJHhYPENCcZ3YFRHOeieWYAgf4xDsvgBHdx7S6tiHtHm6E1NfcrbIEd33o Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 690822c00bf34b2d90eee3e2026c78fb Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2009920425 Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 08:01:41.288580 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 08:01:41.290392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:01:41.290392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2009920425 Jul 27 08:01:41.290392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 690822c00bf34b2d90eee3e2026c78fb Jul 27 08:01:41.290392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2009920425 Jul 27 08:01:41.290392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeShelveTestJSON-2009920425-project Jul 27 08:01:41.290392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 08:01:41.290392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 08:01:41.290392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: eb3d3ca2457b47a29b7c94bd8be450cd Jul 27 08:01:41.290392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2009920425-project Jul 27 08:01:41.290392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 08:01:41.290392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance 880126db-79f5-4c11-a0b5-85a612a1662a could not be found. Jul 27 08:01:41.290392 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': '880126db-79f5-4c11-a0b5-85a612a1662a'} Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 880126db-79f5-4c11-a0b5-85a612a1662a could not be found. Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:01:41.291789 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 880126db-79f5-4c11-a0b5-85a612a1662a could not be found. Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 880126db-79f5-4c11-a0b5-85a612a1662a could not be found. Jul 27 08:01:41.294262 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:41.295772 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ea984ffe-76af-42bb-bfcc-98eda13f1f18 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Returning 404 to user: Instance 880126db-79f5-4c11-a0b5-85a612a1662a could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:01:41.295772 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ea984ffe-76af-42bb-bfcc-98eda13f1f18 tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "DELETE /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 404 len: 111 microversion: 2.20 time: 0.032700 Jul 27 08:01:41.295772 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 637/1253] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Jul 27 08:01:41 2022] DELETE /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 08:01:41.302842 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-aa5a8a98-2ae5-4f2a-a9cb-467b2d343f0a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:41.305906 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-aa5a8a98-2ae5-4f2a-a9cb-467b2d343f0a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] [instance: 880126db-79f5-4c11-a0b5-85a612a1662a] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:01:41.313527 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aa5a8a98-2ae5-4f2a-a9cb-467b2d343f0a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:41.314252 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aa5a8a98-2ae5-4f2a-a9cb-467b2d343f0a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:41.315256 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aa5a8a98-2ae5-4f2a-a9cb-467b2d343f0a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:01:41.315901 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-aa5a8a98-2ae5-4f2a-a9cb-467b2d343f0a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:01:41.336358 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-aa5a8a98-2ae5-4f2a-a9cb-467b2d343f0a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] HTTP exception thrown: Instance 880126db-79f5-4c11-a0b5-85a612a1662a could not be found. Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-aa5a8a98-2ae5-4f2a-a9cb-467b2d343f0a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Request method failure captured: Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a HTTP/1.1 Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O4bp8Zj_qDlg-bwEJhF_0lePKtwlqhoITgzOUBl5V3Ie-Hp1jAqFLIvjXBKXQ6h780mUk5eQjA8Yb8XHGifoBm-khbEDCypukHixCybEhpPLTCRJiHKZtJHhYPENCcZ3YFRHOeieWYAgf4xDsvgBHdx7S6tiHtHm6E1NfcrbIEd33o Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 690822c00bf34b2d90eee3e2026c78fb Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2009920425 Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 08:01:41.338263 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 08:01:41.340000 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/690822c00bf34b2d90eee3e2026c78fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:01:41.340000 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2009920425 Jul 27 08:01:41.340000 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 690822c00bf34b2d90eee3e2026c78fb Jul 27 08:01:41.340000 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2009920425 Jul 27 08:01:41.340000 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-AttachVolumeShelveTestJSON-2009920425-project Jul 27 08:01:41.340000 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 08:01:41.340000 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 08:01:41.340000 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: eb3d3ca2457b47a29b7c94bd8be450cd Jul 27 08:01:41.340000 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2009920425-project Jul 27 08:01:41.340000 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 08:01:41.340000 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Instance 880126db-79f5-4c11-a0b5-85a612a1662a could not be found. Jul 27 08:01:41.340000 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': '880126db-79f5-4c11-a0b5-85a612a1662a'} Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 880126db-79f5-4c11-a0b5-85a612a1662a could not be found. Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:01:41.340934 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:01:41.342963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:01:41.342963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:01:41.342963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:01:41.342963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:01:41.342963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:01:41.342963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:01:41.342963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:01:41.342963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 880126db-79f5-4c11-a0b5-85a612a1662a could not be found. Jul 27 08:01:41.342963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:41.342963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:41.342963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:41.342963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:41.342963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:41.342963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:41.342963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:01:41.342963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:01:41.342963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 880126db-79f5-4c11-a0b5-85a612a1662a could not be found. Jul 27 08:01:41.342963 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:01:41.345185 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-aa5a8a98-2ae5-4f2a-a9cb-467b2d343f0a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] Returning 404 to user: Instance 880126db-79f5-4c11-a0b5-85a612a1662a could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:01:41.346076 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-aa5a8a98-2ae5-4f2a-a9cb-467b2d343f0a tempest-AttachVolumeShelveTestJSON-2009920425 tempest-AttachVolumeShelveTestJSON-2009920425-project] 10.222.0.18 "GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a" status: 404 len: 111 microversion: 2.20 time: 0.047100 Jul 27 08:01:41.347313 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 617/1254] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 27 08:01:41 2022] GET /compute/v2.1/servers/880126db-79f5-4c11-a0b5-85a612a1662a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 08:01:47.399552 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-60c30882-570e-452d-8ff6-bb9b16309272 tempest-VolumesGetTestJSON-76733596 tempest-VolumesGetTestJSON-76733596-project] Action: 'create', calling method: .version_select at 0x7f19fe57aca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1076580647", "metadata": {"Type": "work"}}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:01:47.696967 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-60c30882-570e-452d-8ff6-bb9b16309272 tempest-VolumesGetTestJSON-76733596 tempest-VolumesGetTestJSON-76733596-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.414524 Jul 27 08:01:47.698583 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 638/1255] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Jul 27 08:01:47 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 417 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 27 08:01:47.712341 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a63f2ea2-5e85-4015-a54e-06f0fd52ea7e tempest-VolumesGetTestJSON-76733596 tempest-VolumesGetTestJSON-76733596-project] Calling method '.version_select at 0x7f19fe58ab80>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:47.761805 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a63f2ea2-5e85-4015-a54e-06f0fd52ea7e tempest-VolumesGetTestJSON-76733596 tempest-VolumesGetTestJSON-76733596-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/7630deb8-473c-40a8-a41e-f7274bdf3402" status: 200 len: 353 microversion: 2.1 time: 0.053229 Jul 27 08:01:47.762376 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 618/1256] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Jul 27 08:01:47 2022] GET /compute/v2.1/os-volumes/7630deb8-473c-40a8-a41e-f7274bdf3402 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:01:48.775366 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-812b296d-6480-46fe-a38a-fa467a987f6f tempest-VolumesGetTestJSON-76733596 tempest-VolumesGetTestJSON-76733596-project] Calling method '.version_select at 0x7f1a02a56280>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:48.825794 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-812b296d-6480-46fe-a38a-fa467a987f6f tempest-VolumesGetTestJSON-76733596 tempest-VolumesGetTestJSON-76733596-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/7630deb8-473c-40a8-a41e-f7274bdf3402" status: 200 len: 354 microversion: 2.1 time: 0.054840 Jul 27 08:01:48.826362 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 639/1257] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Jul 27 08:01:48 2022] GET /compute/v2.1/os-volumes/7630deb8-473c-40a8-a41e-f7274bdf3402 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:01:48.839575 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-583bfdc0-93d5-4630-a831-4278990f2608 tempest-VolumesGetTestJSON-76733596 tempest-VolumesGetTestJSON-76733596-project] Calling method '.version_select at 0x7f19fe51c3a0>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:48.889205 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-583bfdc0-93d5-4630-a831-4278990f2608 tempest-VolumesGetTestJSON-76733596 tempest-VolumesGetTestJSON-76733596-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/7630deb8-473c-40a8-a41e-f7274bdf3402" status: 200 len: 354 microversion: 2.1 time: 0.054468 Jul 27 08:01:48.889793 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 619/1258] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Jul 27 08:01:48 2022] GET /compute/v2.1/os-volumes/7630deb8-473c-40a8-a41e-f7274bdf3402 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:01:48.907472 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b65ab869-4017-4c58-9c2a-6ec9685afbfc tempest-VolumesGetTestJSON-76733596 tempest-VolumesGetTestJSON-76733596-project] Calling method '.version_select at 0x7f1a02ba7670>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:48.967870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b65ab869-4017-4c58-9c2a-6ec9685afbfc tempest-VolumesGetTestJSON-76733596 tempest-VolumesGetTestJSON-76733596-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/7630deb8-473c-40a8-a41e-f7274bdf3402" status: 202 len: 0 microversion: 2.1 time: 0.064114 Jul 27 08:01:48.968722 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 640/1259] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Jul 27 08:01:48 2022] DELETE /compute/v2.1/os-volumes/7630deb8-473c-40a8-a41e-f7274bdf3402 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:01:48.977555 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-55a7f704-0671-4544-ae29-2ab79a4725c0 tempest-VolumesGetTestJSON-76733596 tempest-VolumesGetTestJSON-76733596-project] Calling method '.version_select at 0x7f19fe4cb310>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:49.027513 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-55a7f704-0671-4544-ae29-2ab79a4725c0 tempest-VolumesGetTestJSON-76733596 tempest-VolumesGetTestJSON-76733596-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/7630deb8-473c-40a8-a41e-f7274bdf3402" status: 200 len: 353 microversion: 2.1 time: 0.054264 Jul 27 08:01:49.028141 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 620/1260] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Jul 27 08:01:48 2022] GET /compute/v2.1/os-volumes/7630deb8-473c-40a8-a41e-f7274bdf3402 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:01:50.042808 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-cc483c70-f623-4baf-a99f-498979607a17 tempest-VolumesGetTestJSON-76733596 tempest-VolumesGetTestJSON-76733596-project] Calling method '.version_select at 0x7f19fe57ac10>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:01:50.072085 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-cc483c70-f623-4baf-a99f-498979607a17 tempest-VolumesGetTestJSON-76733596 tempest-VolumesGetTestJSON-76733596-project] HTTP exception thrown: Volume 7630deb8-473c-40a8-a41e-f7274bdf3402 could not be found. Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-cc483c70-f623-4baf-a99f-498979607a17 tempest-VolumesGetTestJSON-76733596 tempest-VolumesGetTestJSON-76733596-project] Request method failure captured: Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/os-volumes/7630deb8-473c-40a8-a41e-f7274bdf3402 HTTP/1.1 Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4PDrKMKLpy2uM0vfCVu7aFzSbitNjonaOmP7Ic9TsSDYf2OMF06VqtIcOozAfWH4liZVij4q1yBgVWHp2x3ILk4KStJjih8H63S7NuMoRqAEueXi5mmudb5Hx5bBsJAMXEqyO68h2aXSCSRAF12O1qC0biU1tBgb-PjTXngEWYm0z6k Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 3b9acef2966547d3b6ce1ec928fd23b2 Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesGetTestJSON-76733596 Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 08:01:50.074010 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 08:01:50.075750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3b9acef2966547d3b6ce1ec928fd23b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3b9acef2966547d3b6ce1ec928fd23b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3b9acef2966547d3b6ce1ec928fd23b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3b9acef2966547d3b6ce1ec928fd23b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:01:50.075750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesGetTestJSON-76733596 Jul 27 08:01:50.075750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 3b9acef2966547d3b6ce1ec928fd23b2 Jul 27 08:01:50.075750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesGetTestJSON-76733596 Jul 27 08:01:50.075750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesGetTestJSON-76733596-project Jul 27 08:01:50.075750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 08:01:50.075750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 08:01:50.075750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: 1a2d854b646b4857a8c7006ca66db301 Jul 27 08:01:50.075750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesGetTestJSON-76733596-project Jul 27 08:01:50.075750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: Jul 27 08:01:50.075750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Volume 7630deb8-473c-40a8-a41e-f7274bdf3402 could not be found. Jul 27 08:01:50.075750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': '7630deb8-473c-40a8-a41e-f7274bdf3402'} Jul 27 08:01:50.075750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:01:50.076870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:50.076870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:01:50.076870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:01:50.076870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 08:01:50.076870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 08:01:50.076870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 08:01:50.076870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 08:01:50.076870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 08:01:50.076870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 08:01:50.076870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 08:01:50.076870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 08:01:50.076870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:01:50.076870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:01:50.076870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:01:50.076870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:01:50.076870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7630deb8-473c-40a8-a41e-f7274bdf3402 could not be found. (HTTP 404) (Request-ID: req-6efe1f69-1e26-4453-8af1-c33c447fead1) Jul 27 08:01:50.076870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:50.076870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:50.076870 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:50.078438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:50.078438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 08:01:50.078438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 08:01:50.078438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 08:01:50.078438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 08:01:50.078438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 08:01:50.078438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 08:01:50.078438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 08:01:50.078438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 08:01:50.078438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 08:01:50.078438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 08:01:50.078438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 08:01:50.078438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 08:01:50.078438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 08:01:50.078438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 08:01:50.078438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 08:01:50.078438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 08:01:50.078438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 08:01:50.078438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 08:01:50.079920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 08:01:50.079920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 08:01:50.079920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 08:01:50.079920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 08:01:50.079920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7630deb8-473c-40a8-a41e-f7274bdf3402 could not be found. Jul 27 08:01:50.079920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:50.079920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:50.079920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:50.079920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:50.079920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:50.079920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:50.079920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:01:50.079920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:01:50.079920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 08:01:50.079920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 08:01:50.079920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:01:50.079920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:01:50.079920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 08:01:50.079920 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:01:50.081473 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7630deb8-473c-40a8-a41e-f7274bdf3402 could not be found. Jul 27 08:01:50.081473 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:50.081473 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:01:50.081473 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:50.081473 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:01:50.081473 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:01:50.081473 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:01:50.081473 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:01:50.081473 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:01:50.081473 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7630deb8-473c-40a8-a41e-f7274bdf3402 could not be found. Jul 27 08:01:50.081473 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:01:50.081473 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-cc483c70-f623-4baf-a99f-498979607a17 tempest-VolumesGetTestJSON-76733596 tempest-VolumesGetTestJSON-76733596-project] Returning 404 to user: Volume 7630deb8-473c-40a8-a41e-f7274bdf3402 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:01:50.081473 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-cc483c70-f623-4baf-a99f-498979607a17 tempest-VolumesGetTestJSON-76733596 tempest-VolumesGetTestJSON-76733596-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/7630deb8-473c-40a8-a41e-f7274bdf3402" status: 404 len: 109 microversion: 2.1 time: 0.037853 Jul 27 08:01:50.081473 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 641/1261] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Jul 27 08:01:50 2022] GET /compute/v2.1/os-volumes/7630deb8-473c-40a8-a41e-f7274bdf3402 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:02:13.569512 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:13.570318 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:13.575288 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-2b3849d2-f859-41cc-b510-24496ac37e57 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47eb52a5-b8cf-4c47-b445-ba8626619e1e", "device": "/dev/sdb"}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:02:13.578735 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-2b3849d2-f859-41cc-b510-24496ac37e57 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:02:13.586442 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2b3849d2-f859-41cc-b510-24496ac37e57 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:13.587003 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2b3849d2-f859-41cc-b510-24496ac37e57 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:13.587785 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2b3849d2-f859-41cc-b510-24496ac37e57 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:13.588215 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-2b3849d2-f859-41cc-b510-24496ac37e57 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:13.866724 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-2b3849d2-f859-41cc-b510-24496ac37e57 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "POST /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298210 Jul 27 08:02:13.867380 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 621/1262] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Jul 27 08:02:13 2022] POST /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:02:45.973795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=30 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:45.974536 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=62 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:45.979186 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e1a4768d-c84e-4356-98e6-6a4ebbe5f4ec tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:02:45.979682 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e1a4768d-c84e-4356-98e6-6a4ebbe5f4ec tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:02:45.987238 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e1a4768d-c84e-4356-98e6-6a4ebbe5f4ec tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:45.987680 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e1a4768d-c84e-4356-98e6-6a4ebbe5f4ec tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:45.988438 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e1a4768d-c84e-4356-98e6-6a4ebbe5f4ec tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:45.988866 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e1a4768d-c84e-4356-98e6-6a4ebbe5f4ec tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:46.072887 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-e1a4768d-c84e-4356-98e6-6a4ebbe5f4ec tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lazy-loading 'services' on Instance uuid 0a928a05-d125-4720-ae1d-3518c7073812 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:02:46.152829 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e1a4768d-c84e-4356-98e6-6a4ebbe5f4ec tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812/os-volume_attachments/47eb52a5-b8cf-4c47-b445-ba8626619e1e" status: 202 len: 0 microversion: 2.1 time: 0.180594 Jul 27 08:02:46.153457 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 642/1263] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Jul 27 08:02:45 2022] DELETE /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812/os-volume_attachments/47eb52a5-b8cf-4c47-b445-ba8626619e1e => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:02:48.396379 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-6cd6a008-e5a5-43bb-a606-b31d9eaaa977 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:02:48.396894 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-6cd6a008-e5a5-43bb-a606-b31d9eaaa977 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:02:48.399357 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=2 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:48.400015 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:02:48.405846 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6cd6a008-e5a5-43bb-a606-b31d9eaaa977 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:48.406327 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6cd6a008-e5a5-43bb-a606-b31d9eaaa977 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:48.407168 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6cd6a008-e5a5-43bb-a606-b31d9eaaa977 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:48.407596 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-6cd6a008-e5a5-43bb-a606-b31d9eaaa977 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:48.435767 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-6cd6a008-e5a5-43bb-a606-b31d9eaaa977 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Going to try to terminate instance {{(pid=117779) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:02:48.513541 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-6cd6a008-e5a5-43bb-a606-b31d9eaaa977 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812" status: 204 len: 0 microversion: 2.1 time: 0.120987 Jul 27 08:02:48.514191 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 622/1264] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 08:02:48 2022] DELETE /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:02:48.524587 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f1d409ed-b27a-4de6-9f78-17f1fe2ff2ad tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:02:48.525274 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f1d409ed-b27a-4de6-9f78-17f1fe2ff2ad tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:02:48.531554 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f1d409ed-b27a-4de6-9f78-17f1fe2ff2ad tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:48.531995 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f1d409ed-b27a-4de6-9f78-17f1fe2ff2ad tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:48.532769 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f1d409ed-b27a-4de6-9f78-17f1fe2ff2ad tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:48.533197 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f1d409ed-b27a-4de6-9f78-17f1fe2ff2ad tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:48.679655 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f1d409ed-b27a-4de6-9f78-17f1fe2ff2ad tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:02:48.687817 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f1d409ed-b27a-4de6-9f78-17f1fe2ff2ad tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812" status: 200 len: 1513 microversion: 2.1 time: 0.167141 Jul 27 08:02:48.688353 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 643/1265] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:02:48 2022] GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:02:49.710127 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-76181068-c1a0-4fa0-8902-877d48f515a4 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:02:49.710840 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-76181068-c1a0-4fa0-8902-877d48f515a4 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:02:49.717398 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-76181068-c1a0-4fa0-8902-877d48f515a4 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:49.717845 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-76181068-c1a0-4fa0-8902-877d48f515a4 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:49.719235 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-76181068-c1a0-4fa0-8902-877d48f515a4 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:49.719698 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-76181068-c1a0-4fa0-8902-877d48f515a4 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:49.858476 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-76181068-c1a0-4fa0-8902-877d48f515a4 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:02:49.866044 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-76181068-c1a0-4fa0-8902-877d48f515a4 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812" status: 200 len: 1513 microversion: 2.1 time: 0.160367 Jul 27 08:02:49.866607 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 623/1266] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:02:49 2022] GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:02:50.829903 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ff369f2c-3e66-413d-9544-39b3ebe5b18b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:02:50.830408 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ff369f2c-3e66-413d-9544-39b3ebe5b18b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:02:50.831400 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-f5e525c4-11f0-4ea1-b015-95534900ff1a req-ef5a62e5-f7e7-4eb7-86c1-c0932571f200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b810b7-1fa3-47ca-865e-d3ed7e912d52", "tag": "ec4aad5b-6031-47bc-8942-ce881969099d"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:02:50.836773 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ff369f2c-3e66-413d-9544-39b3ebe5b18b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:50.837220 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ff369f2c-3e66-413d-9544-39b3ebe5b18b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:50.837994 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ff369f2c-3e66-413d-9544-39b3ebe5b18b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:50.838666 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ff369f2c-3e66-413d-9544-39b3ebe5b18b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:50.842708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-f5e525c4-11f0-4ea1-b015-95534900ff1a req-ef5a62e5-f7e7-4eb7-86c1-c0932571f200 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:50.843210 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-f5e525c4-11f0-4ea1-b015-95534900ff1a req-ef5a62e5-f7e7-4eb7-86c1-c0932571f200 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:50.855529 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-f5e525c4-11f0-4ea1-b015-95534900ff1a req-ef5a62e5-f7e7-4eb7-86c1-c0932571f200 service nova] Creating event network-changed:ec4aad5b-6031-47bc-8942-ce881969099d for instance 97b810b7-1fa3-47ca-865e-d3ed7e912d52 on hv-cinder-82549 Jul 27 08:02:50.860807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-f5e525c4-11f0-4ea1-b015-95534900ff1a req-ef5a62e5-f7e7-4eb7-86c1-c0932571f200 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033883 Jul 27 08:02:50.861522 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 624/1267] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 08:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:02:50.867283 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ff369f2c-3e66-413d-9544-39b3ebe5b18b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:02:50.890775 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7574ae05-237e-4954-88a1-05b0d9e8dcdf tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:02:50.892082 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-7574ae05-237e-4954-88a1-05b0d9e8dcdf tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:02:50.899549 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7574ae05-237e-4954-88a1-05b0d9e8dcdf tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:50.900126 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7574ae05-237e-4954-88a1-05b0d9e8dcdf tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:50.901021 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7574ae05-237e-4954-88a1-05b0d9e8dcdf tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:50.901591 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7574ae05-237e-4954-88a1-05b0d9e8dcdf tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:50.987818 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ff369f2c-3e66-413d-9544-39b3ebe5b18b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "DELETE /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 204 len: 0 microversion: 2.1 time: 0.162774 Jul 27 08:02:50.988944 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 644/1268] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 08:02:50 2022] DELETE /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:02:50.998026 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a62a7432-6dd6-448b-a751-6321bc51580a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:02:50.998928 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a62a7432-6dd6-448b-a751-6321bc51580a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:02:51.012203 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a62a7432-6dd6-448b-a751-6321bc51580a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:51.013275 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a62a7432-6dd6-448b-a751-6321bc51580a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:51.013631 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a62a7432-6dd6-448b-a751-6321bc51580a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:51.015998 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a62a7432-6dd6-448b-a751-6321bc51580a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:51.141755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-7574ae05-237e-4954-88a1-05b0d9e8dcdf tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:02:51.153269 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7574ae05-237e-4954-88a1-05b0d9e8dcdf tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812" status: 200 len: 1513 microversion: 2.1 time: 0.268864 Jul 27 08:02:51.167690 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 625/1269] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:02:50 2022] GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 => generated 1513 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:02:51.185631 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a62a7432-6dd6-448b-a751-6321bc51580a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:02:51.193932 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a62a7432-6dd6-448b-a751-6321bc51580a tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1575 microversion: 2.1 time: 0.200429 Jul 27 08:02:51.194618 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 645/1270] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:02:50 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1575 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:02:52.176431 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-8c98ad41-ce23-4829-aa82-b546bb8a0e91 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:02:52.177059 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-8c98ad41-ce23-4829-aa82-b546bb8a0e91 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:02:52.183678 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8c98ad41-ce23-4829-aa82-b546bb8a0e91 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:52.184124 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8c98ad41-ce23-4829-aa82-b546bb8a0e91 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:52.184898 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8c98ad41-ce23-4829-aa82-b546bb8a0e91 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:52.185335 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-8c98ad41-ce23-4829-aa82-b546bb8a0e91 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:52.216099 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-62bf82b7-bf00-4851-af38-e7a65fbd1c7c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:02:52.216712 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-62bf82b7-bf00-4851-af38-e7a65fbd1c7c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:02:52.224117 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-62bf82b7-bf00-4851-af38-e7a65fbd1c7c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:52.224566 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-62bf82b7-bf00-4851-af38-e7a65fbd1c7c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:52.225586 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-62bf82b7-bf00-4851-af38-e7a65fbd1c7c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:52.226022 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-62bf82b7-bf00-4851-af38-e7a65fbd1c7c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:52.363005 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-62bf82b7-bf00-4851-af38-e7a65fbd1c7c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:02:52.375476 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-62bf82b7-bf00-4851-af38-e7a65fbd1c7c tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1575 microversion: 2.1 time: 0.163207 Jul 27 08:02:52.375960 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 646/1271] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:02:52 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:02:52.544265 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-8c98ad41-ce23-4829-aa82-b546bb8a0e91 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:02:52.552596 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-8c98ad41-ce23-4829-aa82-b546bb8a0e91 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812" status: 200 len: 1513 microversion: 2.1 time: 0.380036 Jul 27 08:02:52.562060 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 626/1272] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:02:52 2022] GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 => generated 1513 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:02:52.808530 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-df0ba55c-e2a8-413c-8bf4-117ca4ea98ea req-4e2e4f75-ffa2-4fbf-9ecb-38619c99ff48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a928a05-d125-4720-ae1d-3518c7073812", "name": "network-vif-deleted", "tag": "fb8b490b-3e5d-40e1-8cb6-d21de974401e"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:02:52.819718 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-df0ba55c-e2a8-413c-8bf4-117ca4ea98ea req-4e2e4f75-ffa2-4fbf-9ecb-38619c99ff48 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:52.820288 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-df0ba55c-e2a8-413c-8bf4-117ca4ea98ea req-4e2e4f75-ffa2-4fbf-9ecb-38619c99ff48 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:52.833504 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-df0ba55c-e2a8-413c-8bf4-117ca4ea98ea req-4e2e4f75-ffa2-4fbf-9ecb-38619c99ff48 service nova] Creating event network-vif-deleted:fb8b490b-3e5d-40e1-8cb6-d21de974401e for instance 0a928a05-d125-4720-ae1d-3518c7073812 on hv-cinder-82549 Jul 27 08:02:52.838324 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-df0ba55c-e2a8-413c-8bf4-117ca4ea98ea req-4e2e4f75-ffa2-4fbf-9ecb-38619c99ff48 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033437 Jul 27 08:02:52.838944 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 647/1273] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 08:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:02:53.398535 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-5137c646-84b8-41e3-9067-591383690173 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:02:53.399299 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-5137c646-84b8-41e3-9067-591383690173 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:02:53.413705 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5137c646-84b8-41e3-9067-591383690173 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:53.414161 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5137c646-84b8-41e3-9067-591383690173 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:53.414980 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5137c646-84b8-41e3-9067-591383690173 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:53.415431 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-5137c646-84b8-41e3-9067-591383690173 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:53.575648 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fe96b0e6-3f62-4167-acac-276c487e1e6f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:02:53.577124 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fe96b0e6-3f62-4167-acac-276c487e1e6f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:02:53.587647 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fe96b0e6-3f62-4167-acac-276c487e1e6f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:53.588672 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fe96b0e6-3f62-4167-acac-276c487e1e6f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:53.589891 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fe96b0e6-3f62-4167-acac-276c487e1e6f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:53.591461 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fe96b0e6-3f62-4167-acac-276c487e1e6f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:53.642604 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fe96b0e6-3f62-4167-acac-276c487e1e6f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:53.643097 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fe96b0e6-3f62-4167-acac-276c487e1e6f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:53.643645 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-fe96b0e6-3f62-4167-acac-276c487e1e6f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lazy-loading 'fault' on Instance uuid 0a928a05-d125-4720-ae1d-3518c7073812 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:02:53.695589 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fe96b0e6-3f62-4167-acac-276c487e1e6f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:02:53.704673 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fe96b0e6-3f62-4167-acac-276c487e1e6f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812" status: 200 len: 1309 microversion: 2.1 time: 0.134155 Jul 27 08:02:53.718711 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 648/1274] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:02:53 2022] GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 => generated 1309 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:02:53.853550 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-5137c646-84b8-41e3-9067-591383690173 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:02:53.862444 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-5137c646-84b8-41e3-9067-591383690173 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1575 microversion: 2.1 time: 0.468001 Jul 27 08:02:53.863164 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 627/1275] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:02:53 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1575 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:02:54.726214 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-092954f8-265b-4479-a261-b914c37401eb tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:02:54.726836 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-092954f8-265b-4479-a261-b914c37401eb tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: 0a928a05-d125-4720-ae1d-3518c7073812] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:02:54.733278 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-092954f8-265b-4479-a261-b914c37401eb tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:54.734246 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-092954f8-265b-4479-a261-b914c37401eb tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:54.735024 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-092954f8-265b-4479-a261-b914c37401eb tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:54.735452 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-092954f8-265b-4479-a261-b914c37401eb tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:54.751981 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-092954f8-265b-4479-a261-b914c37401eb tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] HTTP exception thrown: Instance 0a928a05-d125-4720-ae1d-3518c7073812 could not be found. Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-092954f8-265b-4479-a261-b914c37401eb tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Request method failure captured: Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 HTTP/1.1 Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4PDVcpceSqI23LE9WY6S--ivzt34pFzFCe-6bVzghs6RNo5MsZFMqDUyeomXdQ9mDZbpX9dBgC0_TDu8W7_-_GDfEmaYlAdqjuFKjWvx6bDJDmJ2sN60zlHRCtbLfMM56R8P2h-kRlGkfq4boK2hIxzoVJmmBDvnPqprmE0xC8q60HQ Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: ab5d3df5b9a5418e95246ec89a22c7df Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesSnapshotTestJSON-466598156 Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 08:02:54.753804 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 08:02:54.755875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab5d3df5b9a5418e95246ec89a22c7df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ab5d3df5b9a5418e95246ec89a22c7df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab5d3df5b9a5418e95246ec89a22c7df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ab5d3df5b9a5418e95246ec89a22c7df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:02:54.755875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesSnapshotTestJSON-466598156 Jul 27 08:02:54.755875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: ab5d3df5b9a5418e95246ec89a22c7df Jul 27 08:02:54.755875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-466598156 Jul 27 08:02:54.755875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesSnapshotTestJSON-466598156-project Jul 27 08:02:54.755875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 08:02:54.755875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 08:02:54.755875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: 8cf53cae7423436db120a4a0d97affae Jul 27 08:02:54.755875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesSnapshotTestJSON-466598156-project Jul 27 08:02:54.755875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 08:02:54.755875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance 0a928a05-d125-4720-ae1d-3518c7073812 could not be found. Jul 27 08:02:54.755875 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': '0a928a05-d125-4720-ae1d-3518c7073812'} Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a928a05-d125-4720-ae1d-3518c7073812 could not be found. Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:02:54.757016 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:02:54.758628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:02:54.758628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:02:54.758628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:02:54.758628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:02:54.758628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:02:54.758628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:02:54.758628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:02:54.758628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a928a05-d125-4720-ae1d-3518c7073812 could not be found. Jul 27 08:02:54.758628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:02:54.758628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:02:54.758628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:02:54.758628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:02:54.758628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:02:54.758628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:02:54.758628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:02:54.758628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:02:54.758628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a928a05-d125-4720-ae1d-3518c7073812 could not be found. Jul 27 08:02:54.758628 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:02:54.760423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-092954f8-265b-4479-a261-b914c37401eb tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Returning 404 to user: Instance 0a928a05-d125-4720-ae1d-3518c7073812 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:02:54.760423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-092954f8-265b-4479-a261-b914c37401eb tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812" status: 404 len: 111 microversion: 2.1 time: 0.033260 Jul 27 08:02:54.760423 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 649/1276] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:02:54 2022] GET /compute/v2.1/servers/0a928a05-d125-4720-ae1d-3518c7073812 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:02:54.854155 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-aa589b0a-cca7-4410-a0c5-57e34ea4b96c req-fecb6724-39e1-4293-a2de-fcbddd89c85e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b810b7-1fa3-47ca-865e-d3ed7e912d52", "name": "network-vif-deleted", "tag": "ec4aad5b-6031-47bc-8942-ce881969099d"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:02:54.865677 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-aa589b0a-cca7-4410-a0c5-57e34ea4b96c req-fecb6724-39e1-4293-a2de-fcbddd89c85e service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:54.866122 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-aa589b0a-cca7-4410-a0c5-57e34ea4b96c req-fecb6724-39e1-4293-a2de-fcbddd89c85e service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:54.877960 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-aa589b0a-cca7-4410-a0c5-57e34ea4b96c req-fecb6724-39e1-4293-a2de-fcbddd89c85e service nova] Creating event network-vif-deleted:ec4aad5b-6031-47bc-8942-ce881969099d for instance 97b810b7-1fa3-47ca-865e-d3ed7e912d52 on hv-cinder-82549 Jul 27 08:02:54.884187 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-aa589b0a-cca7-4410-a0c5-57e34ea4b96c req-fecb6724-39e1-4293-a2de-fcbddd89c85e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034204 Jul 27 08:02:54.885097 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 628/1277] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 08:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:02:54.888167 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c7d77b24-40a8-4882-bfa8-a32b9fd5c45b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:02:54.888855 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c7d77b24-40a8-4882-bfa8-a32b9fd5c45b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:02:54.895781 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c7d77b24-40a8-4882-bfa8-a32b9fd5c45b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:54.896237 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c7d77b24-40a8-4882-bfa8-a32b9fd5c45b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:54.897019 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c7d77b24-40a8-4882-bfa8-a32b9fd5c45b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:54.897459 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c7d77b24-40a8-4882-bfa8-a32b9fd5c45b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:54.949165 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c7d77b24-40a8-4882-bfa8-a32b9fd5c45b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:54.949611 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c7d77b24-40a8-4882-bfa8-a32b9fd5c45b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:54.950065 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-c7d77b24-40a8-4882-bfa8-a32b9fd5c45b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lazy-loading 'fault' on Instance uuid 97b810b7-1fa3-47ca-865e-d3ed7e912d52 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:02:54.996750 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c7d77b24-40a8-4882-bfa8-a32b9fd5c45b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:02:55.006459 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c7d77b24-40a8-4882-bfa8-a32b9fd5c45b tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 200 len: 1230 microversion: 2.1 time: 0.122982 Jul 27 08:02:55.007038 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 650/1278] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:02:54 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 1230 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:02:56.028956 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-4dad4067-c2de-47e3-ab1e-bd0ad0253cbe tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:02:56.029691 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-4dad4067-c2de-47e3-ab1e-bd0ad0253cbe tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 97b810b7-1fa3-47ca-865e-d3ed7e912d52] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:02:56.035914 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4dad4067-c2de-47e3-ab1e-bd0ad0253cbe tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:56.036360 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4dad4067-c2de-47e3-ab1e-bd0ad0253cbe tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:56.037116 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4dad4067-c2de-47e3-ab1e-bd0ad0253cbe tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:02:56.037549 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-4dad4067-c2de-47e3-ab1e-bd0ad0253cbe tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:02:56.050408 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-4dad4067-c2de-47e3-ab1e-bd0ad0253cbe tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] HTTP exception thrown: Instance 97b810b7-1fa3-47ca-865e-d3ed7e912d52 could not be found. Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-4dad4067-c2de-47e3-ab1e-bd0ad0253cbe tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Request method failure captured: Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 HTTP/1.1 Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O7KpAQ6XfKzTXe-iBA5-JLCsVSF4Y96Cj8-R4OU_NYeCFoCW9MK56UYNRfQ5O0gdUm0FlGdL4FELMiPSW2DsGPZlC8X3bqonPMfDHw7UeH3q39pasJF713Q1KOzLxAbMQUZdaylQTEWzwJeOqeTNKNqEoWSoqd4G0YdtrfpiEPpi84 Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 479f452a345b4c219d32d2ad78183af6 Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-TestVolumeBootPattern-144646060 Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 08:02:56.052027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 08:02:56.053807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/479f452a345b4c219d32d2ad78183af6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_479f452a345b4c219d32d2ad78183af6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/479f452a345b4c219d32d2ad78183af6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/479f452a345b4c219d32d2ad78183af6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:02:56.053807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-TestVolumeBootPattern-144646060 Jul 27 08:02:56.053807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 479f452a345b4c219d32d2ad78183af6 Jul 27 08:02:56.053807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-TestVolumeBootPattern-144646060 Jul 27 08:02:56.053807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-TestVolumeBootPattern-144646060-project Jul 27 08:02:56.053807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 08:02:56.053807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 08:02:56.053807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: 5efb3ea424f8450c883d4757545af18d Jul 27 08:02:56.053807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-TestVolumeBootPattern-144646060-project Jul 27 08:02:56.053807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 08:02:56.053807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Instance 97b810b7-1fa3-47ca-865e-d3ed7e912d52 could not be found. Jul 27 08:02:56.053807 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': '97b810b7-1fa3-47ca-865e-d3ed7e912d52'} Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b810b7-1fa3-47ca-865e-d3ed7e912d52 could not be found. Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:02:56.054795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:02:56.056581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:02:56.056581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:02:56.056581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:02:56.056581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:02:56.056581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:02:56.056581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:02:56.056581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:02:56.056581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b810b7-1fa3-47ca-865e-d3ed7e912d52 could not be found. Jul 27 08:02:56.056581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:02:56.056581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:02:56.056581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:02:56.056581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:02:56.056581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:02:56.056581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:02:56.056581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:02:56.056581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:02:56.056581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b810b7-1fa3-47ca-865e-d3ed7e912d52 could not be found. Jul 27 08:02:56.056581 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:02:56.057935 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-4dad4067-c2de-47e3-ab1e-bd0ad0253cbe tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Returning 404 to user: Instance 97b810b7-1fa3-47ca-865e-d3ed7e912d52 could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:02:56.057935 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-4dad4067-c2de-47e3-ab1e-bd0ad0253cbe tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52" status: 404 len: 111 microversion: 2.1 time: 0.029873 Jul 27 08:02:56.057935 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 629/1279] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:02:56 2022] GET /compute/v2.1/servers/97b810b7-1fa3-47ca-865e-d3ed7e912d52 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:03:07.531188 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7405ff4c-9547-450a-88d1-2fd7cd7a20c9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:07.532348 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7405ff4c-9547-450a-88d1-2fd7cd7a20c9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:07.535336 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:03:07.536108 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:03:07.537546 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-93eb32b9-5ed6-4f08-bf5a-d62c827140df req-22744319-00df-4078-bb67-fec5fccecbf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420dfa7a-bd3b-4449-9928-620bf72f2725", "tag": "ad07f686-5948-477d-8818-90133cb4c39f"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:03:07.544572 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7405ff4c-9547-450a-88d1-2fd7cd7a20c9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:07.545246 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7405ff4c-9547-450a-88d1-2fd7cd7a20c9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:07.545801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7405ff4c-9547-450a-88d1-2fd7cd7a20c9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:07.546590 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7405ff4c-9547-450a-88d1-2fd7cd7a20c9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:07.547356 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:03:07.548916 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:03:07.558721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-93eb32b9-5ed6-4f08-bf5a-d62c827140df req-22744319-00df-4078-bb67-fec5fccecbf7 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:07.559485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-93eb32b9-5ed6-4f08-bf5a-d62c827140df req-22744319-00df-4078-bb67-fec5fccecbf7 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:07.576919 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-93eb32b9-5ed6-4f08-bf5a-d62c827140df req-22744319-00df-4078-bb67-fec5fccecbf7 service nova] Creating event network-changed:ad07f686-5948-477d-8818-90133cb4c39f for instance 420dfa7a-bd3b-4449-9928-620bf72f2725 on hv-cinder-82549 Jul 27 08:03:07.581960 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7405ff4c-9547-450a-88d1-2fd7cd7a20c9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:03:07.583495 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-93eb32b9-5ed6-4f08-bf5a-d62c827140df req-22744319-00df-4078-bb67-fec5fccecbf7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051915 Jul 27 08:03:07.584573 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 630/1280] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 08:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:03:07.679114 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7405ff4c-9547-450a-88d1-2fd7cd7a20c9 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "DELETE /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 204 len: 0 microversion: 2.1 time: 0.152043 Jul 27 08:03:07.683153 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 651/1281] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 08:03:07 2022] DELETE /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:03:07.688841 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-749d533d-fd7b-4c7d-afeb-938264a9f2df tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:07.689603 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-749d533d-fd7b-4c7d-afeb-938264a9f2df tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:07.707110 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-749d533d-fd7b-4c7d-afeb-938264a9f2df tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:07.707610 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-749d533d-fd7b-4c7d-afeb-938264a9f2df tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:07.709008 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-749d533d-fd7b-4c7d-afeb-938264a9f2df tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:07.709460 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-749d533d-fd7b-4c7d-afeb-938264a9f2df tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:07.880324 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-749d533d-fd7b-4c7d-afeb-938264a9f2df tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:07.888981 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-749d533d-fd7b-4c7d-afeb-938264a9f2df tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1574 microversion: 2.1 time: 0.204215 Jul 27 08:03:07.898077 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 631/1282] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:07 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1574 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:03:08.912294 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fb324098-9f7a-4915-ab82-4c7bbc23b7de tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:08.912895 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fb324098-9f7a-4915-ab82-4c7bbc23b7de tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:08.919436 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb324098-9f7a-4915-ab82-4c7bbc23b7de tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:08.919889 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb324098-9f7a-4915-ab82-4c7bbc23b7de tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:08.920660 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb324098-9f7a-4915-ab82-4c7bbc23b7de tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:08.921101 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb324098-9f7a-4915-ab82-4c7bbc23b7de tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:09.054360 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fb324098-9f7a-4915-ab82-4c7bbc23b7de tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:09.061927 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fb324098-9f7a-4915-ab82-4c7bbc23b7de tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1574 microversion: 2.1 time: 0.154261 Jul 27 08:03:09.062524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 652/1283] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:08 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:03:10.084837 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c3cfdc62-5ec1-4fae-89b6-d01697a758e0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:10.085425 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c3cfdc62-5ec1-4fae-89b6-d01697a758e0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:10.091896 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c3cfdc62-5ec1-4fae-89b6-d01697a758e0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:10.092340 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c3cfdc62-5ec1-4fae-89b6-d01697a758e0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:10.093106 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c3cfdc62-5ec1-4fae-89b6-d01697a758e0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:10.093534 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c3cfdc62-5ec1-4fae-89b6-d01697a758e0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:10.223721 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c3cfdc62-5ec1-4fae-89b6-d01697a758e0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:10.231557 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c3cfdc62-5ec1-4fae-89b6-d01697a758e0 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1574 microversion: 2.1 time: 0.151185 Jul 27 08:03:10.232123 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 632/1284] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:10 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:03:11.253490 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2c05bd95-b60a-495e-8383-fac9d68494e5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:11.254103 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2c05bd95-b60a-495e-8383-fac9d68494e5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:11.260639 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2c05bd95-b60a-495e-8383-fac9d68494e5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:11.261084 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2c05bd95-b60a-495e-8383-fac9d68494e5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:11.261857 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2c05bd95-b60a-495e-8383-fac9d68494e5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:11.262296 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2c05bd95-b60a-495e-8383-fac9d68494e5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:11.401995 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2c05bd95-b60a-495e-8383-fac9d68494e5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:11.409823 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2c05bd95-b60a-495e-8383-fac9d68494e5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1574 microversion: 2.1 time: 0.160849 Jul 27 08:03:11.410383 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 653/1285] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:11 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:03:12.440822 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-e34e7f93-c8a8-479d-a076-998893c74b75 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:12.441494 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-e34e7f93-c8a8-479d-a076-998893c74b75 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:12.448027 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e34e7f93-c8a8-479d-a076-998893c74b75 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:12.448474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e34e7f93-c8a8-479d-a076-998893c74b75 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:12.449265 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e34e7f93-c8a8-479d-a076-998893c74b75 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:12.449694 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-e34e7f93-c8a8-479d-a076-998893c74b75 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:12.585203 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-e34e7f93-c8a8-479d-a076-998893c74b75 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:12.592813 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-e34e7f93-c8a8-479d-a076-998893c74b75 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1574 microversion: 2.1 time: 0.156391 Jul 27 08:03:12.593389 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 633/1286] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:12 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:03:12.955603 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-332e947f-3dde-4fbd-8ba7-2f9db997c90d tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-602319064", "imageRef": "646bfb5d-ef25-404a-a432-35d4209840fd", "flavorRef": "452", "networks": [{"uuid": "8bc97ad6-a220-4d27-8325-eed8f0684b9f"}]}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:03:13.023017 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.network.neutron [None req-332e947f-3dde-4fbd-8ba7-2f9db997c90d tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] validate_networks() for [('8bc97ad6-a220-4d27-8325-eed8f0684b9f', None, None, None, None, None)] {{(pid=117780) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 08:03:13.500041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-332e947f-3dde-4fbd-8ba7-2f9db997c90d tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Flavor limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 08:03:13.501174 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-332e947f-3dde-4fbd-8ba7-2f9db997c90d tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Image limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 08:03:13.501174 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-332e947f-3dde-4fbd-8ba7-2f9db997c90d tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Flavor pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 08:03:13.501524 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-332e947f-3dde-4fbd-8ba7-2f9db997c90d tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Image pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 08:03:13.501985 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-332e947f-3dde-4fbd-8ba7-2f9db997c90d tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 08:03:13.511398 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-332e947f-3dde-4fbd-8ba7-2f9db997c90d tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:13.511813 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-332e947f-3dde-4fbd-8ba7-2f9db997c90d tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:13.512820 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-332e947f-3dde-4fbd-8ba7-2f9db997c90d tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:13.513265 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-332e947f-3dde-4fbd-8ba7-2f9db997c90d tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:13.530988 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-332e947f-3dde-4fbd-8ba7-2f9db997c90d tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Getting quotas for project ab5d3df5b9a5418e95246ec89a22c7df. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 08:03:13.536252 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-332e947f-3dde-4fbd-8ba7-2f9db997c90d tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Getting quotas for user 8cf53cae7423436db120a4a0d97affae and project ab5d3df5b9a5418e95246ec89a22c7df. Resources: {'ram', 'cores', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 08:03:13.549343 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-332e947f-3dde-4fbd-8ba7-2f9db997c90d tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Going to run 1 instances... {{(pid=117780) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 27 08:03:13.551570 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-332e947f-3dde-4fbd-8ba7-2f9db997c90d tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='646bfb5d-ef25-404a-a432-35d4209840fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 27 08:03:13.591899 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-d5be512c-7842-4468-a390-ed20f982b963 req-27071500-e650-43f5-b25a-da561098fd4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420dfa7a-bd3b-4449-9928-620bf72f2725", "name": "network-vif-deleted", "tag": "ad07f686-5948-477d-8818-90133cb4c39f"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:03:13.601740 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-332e947f-3dde-4fbd-8ba7-2f9db997c90d tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649701 Jul 27 08:03:13.602304 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-d5be512c-7842-4468-a390-ed20f982b963 req-27071500-e650-43f5-b25a-da561098fd4b service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:13.602484 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 654/1287] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Jul 27 08:03:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 08:03:13.603135 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-d5be512c-7842-4468-a390-ed20f982b963 req-27071500-e650-43f5-b25a-da561098fd4b service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:13.616227 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-d5be512c-7842-4468-a390-ed20f982b963 req-27071500-e650-43f5-b25a-da561098fd4b service nova] Creating event network-vif-deleted:ad07f686-5948-477d-8818-90133cb4c39f for instance 420dfa7a-bd3b-4449-9928-620bf72f2725 on hv-cinder-82549 Jul 27 08:03:13.617479 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-34744d62-dadb-48f5-9097-80789fb35e4e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:13.618098 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-34744d62-dadb-48f5-9097-80789fb35e4e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:13.621284 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-d5be512c-7842-4468-a390-ed20f982b963 req-27071500-e650-43f5-b25a-da561098fd4b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033248 Jul 27 08:03:13.622300 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 634/1288] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 08:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:03:13.629727 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-36d3542b-d626-455e-8a7e-3dc772d16dfe tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:13.630450 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-36d3542b-d626-455e-8a7e-3dc772d16dfe tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:13.637689 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-36d3542b-d626-455e-8a7e-3dc772d16dfe tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:13.638141 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-36d3542b-d626-455e-8a7e-3dc772d16dfe tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:13.639315 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-36d3542b-d626-455e-8a7e-3dc772d16dfe tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:13.639932 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-36d3542b-d626-455e-8a7e-3dc772d16dfe tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:13.676156 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-34744d62-dadb-48f5-9097-80789fb35e4e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:13.683373 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-34744d62-dadb-48f5-9097-80789fb35e4e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb" status: 200 len: 1218 microversion: 2.1 time: 0.074065 Jul 27 08:03:13.683947 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 655/1289] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:13 2022] GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:03:13.715795 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-36d3542b-d626-455e-8a7e-3dc772d16dfe tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efb3ea424f8450c883d4757545af18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479f452a345b4c219d32d2ad78183af6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:13.723997 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-36d3542b-d626-455e-8a7e-3dc772d16dfe tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 200 len: 1224 microversion: 2.1 time: 0.099999 Jul 27 08:03:13.725026 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 635/1290] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:13 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:03:14.705039 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-139b9735-544e-4a71-a498-ffcd35ec7ff3 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:14.705694 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-139b9735-544e-4a71-a498-ffcd35ec7ff3 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:14.712297 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-139b9735-544e-4a71-a498-ffcd35ec7ff3 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:14.712759 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-139b9735-544e-4a71-a498-ffcd35ec7ff3 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:14.713529 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-139b9735-544e-4a71-a498-ffcd35ec7ff3 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:14.713970 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-139b9735-544e-4a71-a498-ffcd35ec7ff3 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:14.746223 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-79ec1a60-2c8b-4130-8bfe-168b38625fe5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:14.747158 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-79ec1a60-2c8b-4130-8bfe-168b38625fe5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: 420dfa7a-bd3b-4449-9928-620bf72f2725] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:14.753689 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-79ec1a60-2c8b-4130-8bfe-168b38625fe5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:14.754132 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-79ec1a60-2c8b-4130-8bfe-168b38625fe5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:14.754916 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-79ec1a60-2c8b-4130-8bfe-168b38625fe5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:14.755353 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-79ec1a60-2c8b-4130-8bfe-168b38625fe5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:14.768809 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-79ec1a60-2c8b-4130-8bfe-168b38625fe5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] HTTP exception thrown: Instance 420dfa7a-bd3b-4449-9928-620bf72f2725 could not be found. Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-79ec1a60-2c8b-4130-8bfe-168b38625fe5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Request method failure captured: Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 HTTP/1.1 Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O7KpAQ6XfKzTXe-iBA5-JLCsVSF4Y96Cj8-R4OU_NYeCFoCW9MK56UYNRfQ5O0gdUm0FlGdL4FELMiPSW2DsGPZlC8X3bqonPMfDHw7UeH3q39pasJF713Q1KOzLxAbMQUZdaylQTEWzwJeOqeTNKNqEoWSoqd4G0YdtrfpiEPpi84 Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 479f452a345b4c219d32d2ad78183af6 Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-TestVolumeBootPattern-144646060 Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 08:03:14.770485 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 08:03:14.772278 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/479f452a345b4c219d32d2ad78183af6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_479f452a345b4c219d32d2ad78183af6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/479f452a345b4c219d32d2ad78183af6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/479f452a345b4c219d32d2ad78183af6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:03:14.772278 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-TestVolumeBootPattern-144646060 Jul 27 08:03:14.772278 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 479f452a345b4c219d32d2ad78183af6 Jul 27 08:03:14.772278 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-TestVolumeBootPattern-144646060 Jul 27 08:03:14.772278 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-TestVolumeBootPattern-144646060-project Jul 27 08:03:14.772278 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 08:03:14.772278 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 08:03:14.772278 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: 5efb3ea424f8450c883d4757545af18d Jul 27 08:03:14.772278 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-TestVolumeBootPattern-144646060-project Jul 27 08:03:14.772278 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 08:03:14.772278 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Instance 420dfa7a-bd3b-4449-9928-620bf72f2725 could not be found. Jul 27 08:03:14.772278 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': '420dfa7a-bd3b-4449-9928-620bf72f2725'} Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 420dfa7a-bd3b-4449-9928-620bf72f2725 could not be found. Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:03:14.773217 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:03:14.775338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:03:14.775338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:03:14.775338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:03:14.775338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:03:14.775338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:03:14.775338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:03:14.775338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:03:14.775338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 420dfa7a-bd3b-4449-9928-620bf72f2725 could not be found. Jul 27 08:03:14.775338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:03:14.775338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:03:14.775338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:03:14.775338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:03:14.775338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:03:14.775338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:03:14.775338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:03:14.775338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:03:14.775338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 420dfa7a-bd3b-4449-9928-620bf72f2725 could not be found. Jul 27 08:03:14.775338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:03:14.777474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-79ec1a60-2c8b-4130-8bfe-168b38625fe5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Returning 404 to user: Instance 420dfa7a-bd3b-4449-9928-620bf72f2725 could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:03:14.777474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-79ec1a60-2c8b-4130-8bfe-168b38625fe5 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725" status: 404 len: 111 microversion: 2.1 time: 0.029643 Jul 27 08:03:14.777474 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 636/1291] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:14 2022] GET /compute/v2.1/servers/420dfa7a-bd3b-4449-9928-620bf72f2725 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 08:03:14.779305 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-139b9735-544e-4a71-a498-ffcd35ec7ff3 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:14.788087 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-139b9735-544e-4a71-a498-ffcd35ec7ff3 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb" status: 200 len: 1270 microversion: 2.1 time: 0.087012 Jul 27 08:03:14.788909 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 656/1292] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:14 2022] GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:03:15.399678 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d7ccecfd-82b4-4cc2-b366-c462742b065e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:15.400317 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-d7ccecfd-82b4-4cc2-b366-c462742b065e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:15.406397 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d7ccecfd-82b4-4cc2-b366-c462742b065e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:15.406843 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d7ccecfd-82b4-4cc2-b366-c462742b065e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:15.407652 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d7ccecfd-82b4-4cc2-b366-c462742b065e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:15.408085 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-d7ccecfd-82b4-4cc2-b366-c462742b065e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:15.422320 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.wsgi [None req-d7ccecfd-82b4-4cc2-b366-c462742b065e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] HTTP exception thrown: Instance d599a647-2c57-4095-8875-7eb9ac54150f could not be found. Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d7ccecfd-82b4-4cc2-b366-c462742b065e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Request method failure captured: Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: request: DELETE /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f HTTP/1.1 Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept: application/json Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Accept-Encoding: identity Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Connection: close Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Length: 0 Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Content-Type: application/json Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Host: 10.222.0.18 Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Openstack-System-Scope: None Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: User-Agent: python-urllib3/1.26.10 Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Auth-Token: gAAAAABi4O7KpAQ6XfKzTXe-iBA5-JLCsVSF4Y96Cj8-R4OU_NYeCFoCW9MK56UYNRfQ5O0gdUm0FlGdL4FELMiPSW2DsGPZlC8X3bqonPMfDHw7UeH3q39pasJF713Q1KOzLxAbMQUZdaylQTEWzwJeOqeTNKNqEoWSoqd4G0YdtrfpiEPpi84 Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Id: None Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Domain-Name: None Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Identity-Status: Confirmed Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Is-Admin-Project: True Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Id: default Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Domain-Name: Default Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Id: 479f452a345b4c219d32d2ad78183af6 Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Project-Name: tempest-TestVolumeBootPattern-144646060 Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Role: reader,member Jul 27 08:03:15.423924 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Roles: reader,member Jul 27 08:03:15.425541 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/479f452a345b4c219d32d2ad78183af6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_479f452a345b4c219d32d2ad78183af6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/479f452a345b4c219d32d2ad78183af6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/479f452a345b4c219d32d2ad78183af6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:03:15.425541 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant: tempest-TestVolumeBootPattern-144646060 Jul 27 08:03:15.425541 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Id: 479f452a345b4c219d32d2ad78183af6 Jul 27 08:03:15.425541 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-Tenant-Name: tempest-TestVolumeBootPattern-144646060 Jul 27 08:03:15.425541 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User: tempest-TestVolumeBootPattern-144646060-project Jul 27 08:03:15.425541 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Id: default Jul 27 08:03:15.425541 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Domain-Name: Default Jul 27 08:03:15.425541 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Id: 5efb3ea424f8450c883d4757545af18d Jul 27 08:03:15.425541 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: X-User-Name: tempest-TestVolumeBootPattern-144646060-project Jul 27 08:03:15.425541 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: method: > Jul 27 08:03:15.425541 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: exception: Instance d599a647-2c57-4095-8875-7eb9ac54150f could not be found. Jul 27 08:03:15.425541 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: action_args: {'id': 'd599a647-2c57-4095-8875-7eb9ac54150f'} Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d599a647-2c57-4095-8875-7eb9ac54150f could not be found. Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:03:15.426393 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d599a647-2c57-4095-8875-7eb9ac54150f could not be found. Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d599a647-2c57-4095-8875-7eb9ac54150f could not be found. Jul 27 08:03:15.427887 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: ERROR nova.api.openstack.wsgi Jul 27 08:03:15.430454 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-d7ccecfd-82b4-4cc2-b366-c462742b065e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Returning 404 to user: Instance d599a647-2c57-4095-8875-7eb9ac54150f could not be found. {{(pid=117779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:03:15.430454 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-d7ccecfd-82b4-4cc2-b366-c462742b065e tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 404 len: 111 microversion: 2.1 time: 0.030424 Jul 27 08:03:15.430454 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 637/1293] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 08:03:15 2022] DELETE /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:03:15.439418 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b663bbca-cee5-4551-a866-b93e4f4ffeb4 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:15.440532 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b663bbca-cee5-4551-a866-b93e4f4ffeb4 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] [instance: d599a647-2c57-4095-8875-7eb9ac54150f] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:15.446753 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b663bbca-cee5-4551-a866-b93e4f4ffeb4 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:15.447267 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b663bbca-cee5-4551-a866-b93e4f4ffeb4 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:15.448176 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b663bbca-cee5-4551-a866-b93e4f4ffeb4 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:15.448766 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b663bbca-cee5-4551-a866-b93e4f4ffeb4 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:15.465348 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-b663bbca-cee5-4551-a866-b93e4f4ffeb4 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] HTTP exception thrown: Instance d599a647-2c57-4095-8875-7eb9ac54150f could not be found. Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b663bbca-cee5-4551-a866-b93e4f4ffeb4 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Request method failure captured: Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f HTTP/1.1 Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4O7KpAQ6XfKzTXe-iBA5-JLCsVSF4Y96Cj8-R4OU_NYeCFoCW9MK56UYNRfQ5O0gdUm0FlGdL4FELMiPSW2DsGPZlC8X3bqonPMfDHw7UeH3q39pasJF713Q1KOzLxAbMQUZdaylQTEWzwJeOqeTNKNqEoWSoqd4G0YdtrfpiEPpi84 Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: 479f452a345b4c219d32d2ad78183af6 Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-TestVolumeBootPattern-144646060 Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 08:03:15.467041 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 08:03:15.468736 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/479f452a345b4c219d32d2ad78183af6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_479f452a345b4c219d32d2ad78183af6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/479f452a345b4c219d32d2ad78183af6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/479f452a345b4c219d32d2ad78183af6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:03:15.468736 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-TestVolumeBootPattern-144646060 Jul 27 08:03:15.468736 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 479f452a345b4c219d32d2ad78183af6 Jul 27 08:03:15.468736 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-TestVolumeBootPattern-144646060 Jul 27 08:03:15.468736 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-TestVolumeBootPattern-144646060-project Jul 27 08:03:15.468736 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 08:03:15.468736 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 08:03:15.468736 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: 5efb3ea424f8450c883d4757545af18d Jul 27 08:03:15.468736 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-TestVolumeBootPattern-144646060-project Jul 27 08:03:15.468736 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 08:03:15.468736 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance d599a647-2c57-4095-8875-7eb9ac54150f could not be found. Jul 27 08:03:15.468736 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': 'd599a647-2c57-4095-8875-7eb9ac54150f'} Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d599a647-2c57-4095-8875-7eb9ac54150f could not be found. Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:03:15.469569 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:03:15.470999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:03:15.470999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:03:15.470999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:03:15.470999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:03:15.470999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:03:15.470999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:03:15.470999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:03:15.470999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d599a647-2c57-4095-8875-7eb9ac54150f could not be found. Jul 27 08:03:15.470999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:03:15.470999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:03:15.470999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:03:15.470999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:03:15.470999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:03:15.470999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:03:15.470999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:03:15.470999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:03:15.470999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d599a647-2c57-4095-8875-7eb9ac54150f could not be found. Jul 27 08:03:15.470999 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:03:15.472300 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b663bbca-cee5-4551-a866-b93e4f4ffeb4 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Returning 404 to user: Instance d599a647-2c57-4095-8875-7eb9ac54150f could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:03:15.472300 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b663bbca-cee5-4551-a866-b93e4f4ffeb4 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f" status: 404 len: 111 microversion: 2.1 time: 0.035720 Jul 27 08:03:15.472300 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 657/1294] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:15 2022] GET /compute/v2.1/servers/d599a647-2c57-4095-8875-7eb9ac54150f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:03:15.811691 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-12464de2-c6d6-46fc-be71-0bff96489339 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:15.813043 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-12464de2-c6d6-46fc-be71-0bff96489339 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:15.822630 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-12464de2-c6d6-46fc-be71-0bff96489339 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:15.823144 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-12464de2-c6d6-46fc-be71-0bff96489339 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:15.824327 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-12464de2-c6d6-46fc-be71-0bff96489339 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:15.824803 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-12464de2-c6d6-46fc-be71-0bff96489339 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:16.038332 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-12464de2-c6d6-46fc-be71-0bff96489339 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:16.045881 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-12464de2-c6d6-46fc-be71-0bff96489339 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb" status: 200 len: 1318 microversion: 2.1 time: 0.238954 Jul 27 08:03:16.046451 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 638/1295] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:15 2022] GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:03:16.556972 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-2df45d6f-90a3-49ff-9380-4c42a509a241 req-6affe3db-38f5-49a7-917a-de0395166537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef74beac-705d-4488-a7e8-286e2cbe59fb", "tag": "68730ffd-57d9-4dcc-8866-de04e210c075"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:03:16.579322 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-2df45d6f-90a3-49ff-9380-4c42a509a241 req-6affe3db-38f5-49a7-917a-de0395166537 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:16.579819 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-2df45d6f-90a3-49ff-9380-4c42a509a241 req-6affe3db-38f5-49a7-917a-de0395166537 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:16.592574 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-2df45d6f-90a3-49ff-9380-4c42a509a241 req-6affe3db-38f5-49a7-917a-de0395166537 service nova] Creating event network-changed:68730ffd-57d9-4dcc-8866-de04e210c075 for instance ef74beac-705d-4488-a7e8-286e2cbe59fb on hv-cinder-82549 Jul 27 08:03:16.598970 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-2df45d6f-90a3-49ff-9380-4c42a509a241 req-6affe3db-38f5-49a7-917a-de0395166537 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045880 Jul 27 08:03:16.599708 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 658/1296] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 08:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:03:16.939432 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-22242e3b-e5b9-4b53-a63e-999b567d91b6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] Calling method '.version_select at 0x7f19fe49d280>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:16.964920 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-22242e3b-e5b9-4b53-a63e-999b567d91b6 tempest-TestVolumeBootPattern-144646060 tempest-TestVolumeBootPattern-144646060-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-506878589" status: 202 len: 0 microversion: 2.1 time: 0.029329 Jul 27 08:03:16.965822 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 639/1297] 10.222.0.18 () {58 vars in 1260 bytes} [Wed Jul 27 08:03:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-506878589 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:03:17.069896 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b76ab841-06be-47a9-9f81-99e2218c3a1a tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:17.070602 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b76ab841-06be-47a9-9f81-99e2218c3a1a tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:17.077717 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b76ab841-06be-47a9-9f81-99e2218c3a1a tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:17.078416 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b76ab841-06be-47a9-9f81-99e2218c3a1a tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:17.079396 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b76ab841-06be-47a9-9f81-99e2218c3a1a tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:17.080003 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b76ab841-06be-47a9-9f81-99e2218c3a1a tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:17.223583 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b76ab841-06be-47a9-9f81-99e2218c3a1a tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:17.232066 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b76ab841-06be-47a9-9f81-99e2218c3a1a tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb" status: 200 len: 1318 microversion: 2.1 time: 0.166822 Jul 27 08:03:17.232645 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 659/1298] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:17 2022] GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:03:18.261071 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-c1ae557d-f68a-4f27-b9a7-aa2be12965f5 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:18.264803 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-c1ae557d-f68a-4f27-b9a7-aa2be12965f5 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:18.286627 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c1ae557d-f68a-4f27-b9a7-aa2be12965f5 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:18.286627 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c1ae557d-f68a-4f27-b9a7-aa2be12965f5 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:18.292460 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c1ae557d-f68a-4f27-b9a7-aa2be12965f5 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:18.293235 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-c1ae557d-f68a-4f27-b9a7-aa2be12965f5 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:18.520011 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-c1ae557d-f68a-4f27-b9a7-aa2be12965f5 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:18.530373 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-c1ae557d-f68a-4f27-b9a7-aa2be12965f5 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb" status: 200 len: 1318 microversion: 2.1 time: 0.273521 Jul 27 08:03:18.534865 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 640/1299] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:18 2022] GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:03:19.551867 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-072bc262-df50-40cb-8a3c-8349f093b4c9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:19.553244 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-072bc262-df50-40cb-8a3c-8349f093b4c9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:19.560693 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-072bc262-df50-40cb-8a3c-8349f093b4c9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:19.561153 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-072bc262-df50-40cb-8a3c-8349f093b4c9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:19.561950 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-072bc262-df50-40cb-8a3c-8349f093b4c9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:19.562393 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-072bc262-df50-40cb-8a3c-8349f093b4c9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:19.832878 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-072bc262-df50-40cb-8a3c-8349f093b4c9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:19.842721 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-072bc262-df50-40cb-8a3c-8349f093b4c9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb" status: 200 len: 1318 microversion: 2.1 time: 0.295433 Jul 27 08:03:19.847321 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 660/1300] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:19 2022] GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:03:20.868740 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-be62836a-ed13-4514-8436-1a63de184c1c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:20.871062 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-be62836a-ed13-4514-8436-1a63de184c1c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:20.886443 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-be62836a-ed13-4514-8436-1a63de184c1c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:20.887178 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-be62836a-ed13-4514-8436-1a63de184c1c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:20.888338 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-be62836a-ed13-4514-8436-1a63de184c1c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:20.888857 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-be62836a-ed13-4514-8436-1a63de184c1c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:21.030380 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-be62836a-ed13-4514-8436-1a63de184c1c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:21.038679 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-be62836a-ed13-4514-8436-1a63de184c1c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb" status: 200 len: 1318 microversion: 2.1 time: 0.174331 Jul 27 08:03:21.039292 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 641/1301] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:20 2022] GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:03:22.060317 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-637eec23-4add-4e1b-983d-d63afcec3f0f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:22.060975 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-637eec23-4add-4e1b-983d-d63afcec3f0f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:22.067791 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-637eec23-4add-4e1b-983d-d63afcec3f0f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:22.068246 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-637eec23-4add-4e1b-983d-d63afcec3f0f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:22.069028 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-637eec23-4add-4e1b-983d-d63afcec3f0f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:22.069471 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-637eec23-4add-4e1b-983d-d63afcec3f0f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:22.260274 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-637eec23-4add-4e1b-983d-d63afcec3f0f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:22.268982 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-637eec23-4add-4e1b-983d-d63afcec3f0f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb" status: 200 len: 1318 microversion: 2.1 time: 0.212365 Jul 27 08:03:22.279897 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 661/1302] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:22 2022] GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:03:22.840622 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [req-9d4e5d48-4ee6-437f-b11a-d48b612a1000 req-aa7ca738-977a-4087-a8d1-4502bcba6cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef74beac-705d-4488-a7e8-286e2cbe59fb", "name": "network-vif-plugged", "status": "completed", "tag": "68730ffd-57d9-4dcc-8866-de04e210c075"}]} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:03:22.851611 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-9d4e5d48-4ee6-437f-b11a-d48b612a1000 req-aa7ca738-977a-4087-a8d1-4502bcba6cc4 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:22.852234 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [req-9d4e5d48-4ee6-437f-b11a-d48b612a1000 req-aa7ca738-977a-4087-a8d1-4502bcba6cc4 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:22.864599 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.compute.server_external_events [req-9d4e5d48-4ee6-437f-b11a-d48b612a1000 req-aa7ca738-977a-4087-a8d1-4502bcba6cc4 service nova] Creating event network-vif-plugged:68730ffd-57d9-4dcc-8866-de04e210c075 for instance ef74beac-705d-4488-a7e8-286e2cbe59fb on hv-cinder-82549 Jul 27 08:03:22.869687 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [req-9d4e5d48-4ee6-437f-b11a-d48b612a1000 req-aa7ca738-977a-4087-a8d1-4502bcba6cc4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032827 Jul 27 08:03:22.870284 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 642/1303] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 08:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:03:23.291815 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-55bb5e53-8856-47e3-81f9-7c8fb855f003 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:23.292437 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-55bb5e53-8856-47e3-81f9-7c8fb855f003 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:23.299858 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55bb5e53-8856-47e3-81f9-7c8fb855f003 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:23.300312 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55bb5e53-8856-47e3-81f9-7c8fb855f003 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:23.301103 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55bb5e53-8856-47e3-81f9-7c8fb855f003 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:23.301539 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-55bb5e53-8856-47e3-81f9-7c8fb855f003 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:23.474355 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-55bb5e53-8856-47e3-81f9-7c8fb855f003 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:23.488062 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-55bb5e53-8856-47e3-81f9-7c8fb855f003 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb" status: 200 len: 1318 microversion: 2.1 time: 0.199267 Jul 27 08:03:23.488894 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 662/1304] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:23 2022] GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:03:24.514058 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-dfda805d-c9b5-4e65-bb7d-244794a1eaa4 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:24.515604 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-dfda805d-c9b5-4e65-bb7d-244794a1eaa4 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:24.525977 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dfda805d-c9b5-4e65-bb7d-244794a1eaa4 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:24.526708 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dfda805d-c9b5-4e65-bb7d-244794a1eaa4 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:24.527519 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dfda805d-c9b5-4e65-bb7d-244794a1eaa4 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:24.528269 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-dfda805d-c9b5-4e65-bb7d-244794a1eaa4 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:24.670494 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-dfda805d-c9b5-4e65-bb7d-244794a1eaa4 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:24.679875 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-dfda805d-c9b5-4e65-bb7d-244794a1eaa4 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb" status: 200 len: 1318 microversion: 2.1 time: 0.172487 Jul 27 08:03:24.680762 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 643/1305] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:24 2022] GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:03:25.702420 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-50635d4b-14a9-43f8-93f6-b0dfdc17a02f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:25.703019 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-50635d4b-14a9-43f8-93f6-b0dfdc17a02f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:25.704946 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:03:25.706321 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=8 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:03:25.713061 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-50635d4b-14a9-43f8-93f6-b0dfdc17a02f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:25.713501 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-50635d4b-14a9-43f8-93f6-b0dfdc17a02f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:25.714261 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-50635d4b-14a9-43f8-93f6-b0dfdc17a02f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:25.714690 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-50635d4b-14a9-43f8-93f6-b0dfdc17a02f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:25.843447 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-50635d4b-14a9-43f8-93f6-b0dfdc17a02f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:25.851480 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-50635d4b-14a9-43f8-93f6-b0dfdc17a02f tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb" status: 200 len: 1507 microversion: 2.1 time: 0.152995 Jul 27 08:03:25.852079 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 663/1306] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:25 2022] GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:03:25.871755 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-7354a5f4-e202-4265-937a-4d1a9809260c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d4b4fbd-0d4d-4597-92e5-715fe13ae12a", "device": "/dev/sdb"}} {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:03:25.874110 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-7354a5f4-e202-4265-937a-4d1a9809260c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:25.881305 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7354a5f4-e202-4265-937a-4d1a9809260c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:25.881756 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7354a5f4-e202-4265-937a-4d1a9809260c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:25.882532 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7354a5f4-e202-4265-937a-4d1a9809260c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:25.882997 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-7354a5f4-e202-4265-937a-4d1a9809260c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:26.130466 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-7354a5f4-e202-4265-937a-4d1a9809260c tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "POST /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262551 Jul 27 08:03:26.131138 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 644/1307] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Jul 27 08:03:25 2022] POST /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 08:03:47.538070 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-cacf3f24-8fa4-4a19-8460-dc0f85e47381 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:47.538625 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-cacf3f24-8fa4-4a19-8460-dc0f85e47381 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:47.540801 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:03:47.541545 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:03:47.547483 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cacf3f24-8fa4-4a19-8460-dc0f85e47381 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:47.547924 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cacf3f24-8fa4-4a19-8460-dc0f85e47381 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:47.548679 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cacf3f24-8fa4-4a19-8460-dc0f85e47381 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:47.549107 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cacf3f24-8fa4-4a19-8460-dc0f85e47381 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:47.630940 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-cacf3f24-8fa4-4a19-8460-dc0f85e47381 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lazy-loading 'services' on Instance uuid ef74beac-705d-4488-a7e8-286e2cbe59fb {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 08:03:47.702979 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-cacf3f24-8fa4-4a19-8460-dc0f85e47381 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb/os-volume_attachments/9d4b4fbd-0d4d-4597-92e5-715fe13ae12a" status: 202 len: 0 microversion: 2.1 time: 0.169117 Jul 27 08:03:47.703573 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 664/1308] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Jul 27 08:03:47 2022] DELETE /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb/os-volume_attachments/9d4b4fbd-0d4d-4597-92e5-715fe13ae12a => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 08:03:48.821611 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:03:48.822417 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG dbcounter [-] [117779] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:03:48.826987 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-a83d7835-85a8-4f83-9499-fd29b1817480 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:48.827580 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a83d7835-85a8-4f83-9499-fd29b1817480 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:48.835621 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a83d7835-85a8-4f83-9499-fd29b1817480 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:48.836075 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a83d7835-85a8-4f83-9499-fd29b1817480 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:48.836854 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a83d7835-85a8-4f83-9499-fd29b1817480 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:48.837291 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-a83d7835-85a8-4f83-9499-fd29b1817480 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:48.865048 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-a83d7835-85a8-4f83-9499-fd29b1817480 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] Going to try to terminate instance {{(pid=117779) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 27 08:03:48.941711 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-a83d7835-85a8-4f83-9499-fd29b1817480 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb" status: 204 len: 0 microversion: 2.1 time: 0.121321 Jul 27 08:03:48.942288 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 645/1309] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Jul 27 08:03:48 2022] DELETE /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 08:03:48.955476 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-25bdea5a-4023-47e9-b521-37f6f72130d2 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:48.956190 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-25bdea5a-4023-47e9-b521-37f6f72130d2 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:48.962381 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-25bdea5a-4023-47e9-b521-37f6f72130d2 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:48.962830 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-25bdea5a-4023-47e9-b521-37f6f72130d2 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:48.963634 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-25bdea5a-4023-47e9-b521-37f6f72130d2 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:48.964072 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-25bdea5a-4023-47e9-b521-37f6f72130d2 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:49.101859 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-25bdea5a-4023-47e9-b521-37f6f72130d2 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:49.109394 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-25bdea5a-4023-47e9-b521-37f6f72130d2 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb" status: 200 len: 1513 microversion: 2.1 time: 0.161114 Jul 27 08:03:49.109964 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 665/1310] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:48 2022] GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:03:50.132373 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-45957d32-01c9-4924-a575-a3cad66921d9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:50.133082 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-45957d32-01c9-4924-a575-a3cad66921d9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:50.139589 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-45957d32-01c9-4924-a575-a3cad66921d9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:50.140038 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-45957d32-01c9-4924-a575-a3cad66921d9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:50.140808 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-45957d32-01c9-4924-a575-a3cad66921d9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:50.141244 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-45957d32-01c9-4924-a575-a3cad66921d9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:50.270617 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-45957d32-01c9-4924-a575-a3cad66921d9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:50.279035 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-45957d32-01c9-4924-a575-a3cad66921d9 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb" status: 200 len: 1513 microversion: 2.1 time: 0.151565 Jul 27 08:03:50.279615 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 646/1311] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:50 2022] GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 08:03:51.268583 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-e598796e-4fa2-4a39-9e33-ec61e92babc3 req-2c58e88b-194e-4e86-ae23-68b5064f0e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef74beac-705d-4488-a7e8-286e2cbe59fb", "name": "network-vif-deleted", "tag": "68730ffd-57d9-4dcc-8866-de04e210c075"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 08:03:51.280456 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-e598796e-4fa2-4a39-9e33-ec61e92babc3 req-2c58e88b-194e-4e86-ae23-68b5064f0e32 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:51.280902 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-e598796e-4fa2-4a39-9e33-ec61e92babc3 req-2c58e88b-194e-4e86-ae23-68b5064f0e32 service nova] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:51.292413 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-e598796e-4fa2-4a39-9e33-ec61e92babc3 req-2c58e88b-194e-4e86-ae23-68b5064f0e32 service nova] Creating event network-vif-deleted:68730ffd-57d9-4dcc-8866-de04e210c075 for instance ef74beac-705d-4488-a7e8-286e2cbe59fb on hv-cinder-82549 Jul 27 08:03:51.297795 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-e598796e-4fa2-4a39-9e33-ec61e92babc3 req-2c58e88b-194e-4e86-ae23-68b5064f0e32 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032830 Jul 27 08:03:51.298576 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 666/1312] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 27 08:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 08:03:51.300004 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.api.openstack.wsgi [None req-18c6ae4c-db1a-4bb7-8964-227d388ce034 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:51.301456 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.compute.api [None req-18c6ae4c-db1a-4bb7-8964-227d388ce034 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] Fetching instance by UUID {{(pid=117779) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:51.308771 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-18c6ae4c-db1a-4bb7-8964-227d388ce034 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:51.309150 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-18c6ae4c-db1a-4bb7-8964-227d388ce034 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:51.309957 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-18c6ae4c-db1a-4bb7-8964-227d388ce034 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:51.310674 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG oslo_concurrency.lockutils [None req-18c6ae4c-db1a-4bb7-8964-227d388ce034 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:51.377046 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: DEBUG nova.policy [None req-18c6ae4c-db1a-4bb7-8964-227d388ce034 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cf53cae7423436db120a4a0d97affae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5d3df5b9a5418e95246ec89a22c7df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117779) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 08:03:51.385378 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO nova.api.openstack.requestlog [None req-18c6ae4c-db1a-4bb7-8964-227d388ce034 tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb" status: 200 len: 1303 microversion: 2.1 time: 0.089771 Jul 27 08:03:51.385957 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: [pid: 117779|app: 0|req: 647/1313] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:51 2022] GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb => generated 1303 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 08:03:52.407910 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9c4bdd39-254d-4076-a0fd-b2a77379ec3e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 08:03:52.408611 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9c4bdd39-254d-4076-a0fd-b2a77379ec3e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] [instance: ef74beac-705d-4488-a7e8-286e2cbe59fb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 27 08:03:52.415520 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9c4bdd39-254d-4076-a0fd-b2a77379ec3e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:52.415971 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9c4bdd39-254d-4076-a0fd-b2a77379ec3e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:52.416822 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9c4bdd39-254d-4076-a0fd-b2a77379ec3e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 08:03:52.417306 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9c4bdd39-254d-4076-a0fd-b2a77379ec3e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Lock "8012c5f4-8f3d-458c-9a7b-e2ba04f8d13b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 08:03:52.431049 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-9c4bdd39-254d-4076-a0fd-b2a77379ec3e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] HTTP exception thrown: Instance ef74beac-705d-4488-a7e8-286e2cbe59fb could not be found. Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9c4bdd39-254d-4076-a0fd-b2a77379ec3e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Request method failure captured: Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb HTTP/1.1 Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Connection: close Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Host: 10.222.0.18 Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi4PDVcpceSqI23LE9WY6S--ivzt34pFzFCe-6bVzghs6RNo5MsZFMqDUyeomXdQ9mDZbpX9dBgC0_TDu8W7_-_GDfEmaYlAdqjuFKjWvx6bDJDmJ2sN60zlHRCtbLfMM56R8P2h-kRlGkfq4boK2hIxzoVJmmBDvnPqprmE0xC8q60HQ Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Id: ab5d3df5b9a5418e95246ec89a22c7df Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesSnapshotTestJSON-466598156 Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 27 08:03:52.432705 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 27 08:03:52.434550 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab5d3df5b9a5418e95246ec89a22c7df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ab5d3df5b9a5418e95246ec89a22c7df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab5d3df5b9a5418e95246ec89a22c7df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ab5d3df5b9a5418e95246ec89a22c7df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}] Jul 27 08:03:52.434550 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesSnapshotTestJSON-466598156 Jul 27 08:03:52.434550 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Id: ab5d3df5b9a5418e95246ec89a22c7df Jul 27 08:03:52.434550 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-466598156 Jul 27 08:03:52.434550 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesSnapshotTestJSON-466598156-project Jul 27 08:03:52.434550 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 27 08:03:52.434550 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 27 08:03:52.434550 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Id: 8cf53cae7423436db120a4a0d97affae Jul 27 08:03:52.434550 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesSnapshotTestJSON-466598156-project Jul 27 08:03:52.434550 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: method: > Jul 27 08:03:52.434550 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: exception: Instance ef74beac-705d-4488-a7e8-286e2cbe59fb could not be found. Jul 27 08:03:52.434550 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: action_args: {'id': 'ef74beac-705d-4488-a7e8-286e2cbe59fb'} Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef74beac-705d-4488-a7e8-286e2cbe59fb could not be found. Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 08:03:52.435619 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 08:03:52.437428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 08:03:52.437428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 08:03:52.437428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 08:03:52.437428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 08:03:52.437428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 08:03:52.437428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 08:03:52.437428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 08:03:52.437428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef74beac-705d-4488-a7e8-286e2cbe59fb could not be found. Jul 27 08:03:52.437428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:03:52.437428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 08:03:52.437428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:03:52.437428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 08:03:52.437428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 08:03:52.437428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 08:03:52.437428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 08:03:52.437428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 08:03:52.437428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef74beac-705d-4488-a7e8-286e2cbe59fb could not be found. Jul 27 08:03:52.437428 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 27 08:03:52.439058 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9c4bdd39-254d-4076-a0fd-b2a77379ec3e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] Returning 404 to user: Instance ef74beac-705d-4488-a7e8-286e2cbe59fb could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 08:03:52.439058 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9c4bdd39-254d-4076-a0fd-b2a77379ec3e tempest-VolumesSnapshotTestJSON-466598156 tempest-VolumesSnapshotTestJSON-466598156-project] 10.222.0.18 "GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb" status: 404 len: 111 microversion: 2.1 time: 0.030949 Jul 27 08:03:52.439058 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 667/1314] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Jul 27 08:03:52 2022] GET /compute/v2.1/servers/ef74beac-705d-4488-a7e8-286e2cbe59fb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 08:04:45.174318 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 08:04:45.174976 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Wed Jul 27 08:04:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 08:06:15.580907 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 08:06:15.581590 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Wed Jul 27 08:06:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 08:06:30.012336 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 08:06:30.013169 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Wed Jul 27 08:06:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 08:06:31.816810 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 08:06:31.817338 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Wed Jul 27 08:06:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 08:06:46.724785 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 08:06:46.725541 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Wed Jul 27 08:06:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 08:06:53.510672 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 08:06:53.511235 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Wed Jul 27 08:06:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 08:08:05.182426 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 08:08:05.183247 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Wed Jul 27 08:08:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 08:09:35.590678 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 08:09:35.591695 dv-cinder-825492-32-iscsi devstack@n-api.service[117779]: Wed Jul 27 08:09:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 08:09:50.021426 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 08:09:50.022051 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Wed Jul 27 08:09:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 08:09:51.824620 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 08:09:51.826147 dv-cinder-825492-32-iscsi devstack@n-api.service[117780]: Wed Jul 27 08:09:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!